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ATTNG-TDI-ORA 

PROCEEDINGS  OF  THE  TRADOC  CHIEFS  OF  ANALYSIS  SEMINAR 

14-16  August  1979 
Newport  News,  VA 

1.  The  second  TRADOC  Chiefs  of  Analysis  Seminar  was  held  at 
the  Newport  News  Holiday  Inn,  Newport  News,  VA,  on  14  thru 
16  August  1979.  The  major  theme  for  this  seminar  was  "Soft 
Skill  Analysis",  however,  other  topics  requested  at  a  pre¬ 
vious  seminar  and  subsequent  to  that  time  were  incorporated 
in  the  agenda  items. 

2.  The  sponsor  for  this  seminar  was  the  Occupational 

Research  and  Analysis  Division  (ORAD) ,  of  the  Training 
Developments  Institute  {TDI ) ,  Fort  Monroe,  VA  23651 
(Telephone:  Comm  804-727-3608,  AV  680-3608). 

3.  The  purpose  of  the  Chiefs  of  Analysis  seminars  is  to 
provide  a  forum  in  which  the  TRADOC  service  school's  chiefs 
of  analysis  can  interact  with  their  peers  and  the  TRADOC 
agency  tasked  with  the  proponency  for  job  and  task  analysis 
policy  and  training  (ORAD,  TDI). 

4.  Seminar  presentations  are  provided  in  their  entirety  for 
empirical  purposes  and  to  avoid  misinterpretation  of  the 
data/facts  provided.  Because  of  the  nature  of  this  research 
(i.e.,  to  resolve  the  training  development  community's 
problem  in  coping  with  soft  skill  analysis)  this  effort  is 
considered  to  be  but  one  phase  of  the  overall  soft  skill 
analysis  (SSA)  effort  to  provide  guidance  on: 

o  SSA  Identification 

o  SSA  Procedures 

o  SSA  Testing 

5.  The  presentations  are  not  meant  to  reflect  official 
TRADOC  views  on  the  subjects.  The  intent  of  these  seminars 
is  to  permit  the  service  schools  and  invited  speakers  to 
present  their  opinions  on  varied  subjects  and  solicit  feed¬ 
back  so  as  to  better  our  analysis  efforts.  In  the  area  of 
SSA  there  is  no  one  way  to  accomplish  this  effort.  Research 
conducted  by  ORAD  has  indicated  that  many  individuals  and 


agencies  have  indicated  a  need  to  have  a  process,  provided 
general  comments  about  the  problem,  failed  to  provide  proce¬ 
dural  guidance  on  "How  to"  do  the  process;  especially  when 
the  guidance  must  be  directed  to  novice  analysts  in  the 
TRADOC  service  schools  (e.g.,  enlisted  personnel  in  grades 
E6-E8  and  officers  in  grades  03-04)  being  assigned  without 
support  of  training  or  education  to  equip  them  with  the 
skills  required  to  do  their  job.  To  this  end  ORAD  is 
devoted  to  continue  their  research  mission  and  support  the 
analysis  efforts  for  OPMS  and  EPMS.  To  assist  in  achieving 
this  effort  ORAD-TDI  effected  a  scientific  support  contract 
through  the  Army  Research  Office,  Durham,  NC  from  which  the 
support  of  the  following  individuals  was  obtained: 

Dr.  Robert  Branson,  Florida  State  University 
Dr.  Robert  Gagne,  Florida  State  University 
Mr.  Ivan  Horabin,  Consultant 
Dr.  Charles  Reigeluth,  Syracuse  Univesity 
Dr.  David  Merrill,  Courseware,  San  Diego 

6.  The  agenda  for  this  seminar  is  at  inclosure  1.  List  of 
attendees  is  at  inclosure  2. 

7.  Executive  Summary  of  the  Presentations: 

a.  Welcome/Opening  Remarks  (LTC  Brad  Walton,  Chief, 
Occupational  Research  and  Analysis  Division) :  LTC  Walton 
described  the  purpose  of  the  TRADOC  Chiefs  of  Analysis 
Seminars,  the  organizational  structure  of  TDI ,  the  Soft 
Skill  Analysis  milestones  and  the  status  of  TRADOC  Pamphlet 
351-4  (T) ,  Job  and  Task  Analysis  (J&TA)  Handbook  and  the 
TRADOC  J&TA  Course  (Slides  at  Incl  3) . 

b.  Service  School  Perspectives  of  SSA  (CPT  Robert  Begland, 
ORAD) :  CPT  Begland  provided  feedback  to  the  attendees  on 
responses  received  from  the  service  schools,  as  a  result  of 

an  ORAD  tasking  message  on  how  they  perceive  SSA  and  how 
they  integrate  in  functional  categories  by  service  school 
and  the  present  list  of  officer  common  tasks.  Backup 
material  is  at  Incl  4. 

c.  Seminar  Expectations  (LTC  Walton):  This  session  was 
held  to  determine  what  each  attendee's  expectations  were  at 
the  onset  of  this  seminar.  Rationale  for  this  exercise  was 
that  prior  to  the  seminar  many  prospective  attendees  called 
ORAD  with  the  impression  that  the  seminar  was  to  be  a  soft 


skill  analysis  workshop:  to  deseminate  TRADOC 
policy/guidance  on  how  to  perform  soft  skill  analysis 
(Slides  at  Incl  5) .  In  reality,  the  seminar  was  held  to 
solicit  and  elicit  more  data  from  the  service  schools  and 
quest  speakers  on  the  subject  of  soft  skill  analysis.  In 
turn,  the  above  mentioned  scientific  support  personnel  (SSP) 
were  able  to  obtain  first-hand  knowledqe/responses  on  a  1:1 
ratio. 


d.  Task  Analysis  Level  of  Specificity  for  SSA  (Mr.  John 
Brady,  ADMINCEN) :  Mr.  Brady  discussed  the  ADMINCEN's  cate¬ 
gories  for  soft  skill  tasks  (e.g.,  interper sonel ,  judgmental 
and  creative  tasks)  and  characteristics/examples/comments 
for  each  (slides  at  Incl  6) . 

e.  USAADS  SOP  for  Selection  of  Critical  Tasks  and 
Training  Sites  (Mr.  Gene  Stapher,  Air  Defense  School):  Mr. 
Stapher  presented  the  Air  Defense  School's  process  for  cri¬ 
tical  task  selection  and  training  site  recommendation  as 
being  implemented  at  that  school.  Supporting  documentation 
for  his  presentation  is  at  Incl  7. 

f.  ISD  useage  in  Foreign  Language  Training  (Dr.  Paul 
Madarasz,  Defense  Language  Institute):  Dr.  Madarasz 
described  the  process  used  by  DLI  in  delineating  job  data 
requirements  for  the  96C  Interrogator  involved  in  inter¬ 
viewing  requirements.  The  approach  used  is  outlined  in  a 
summary  flowchart  and  data  display  at  incl  8. 

g.  Job  Task  Analysis  vs  Task  Analysis:  (Mrs  Martha  Gan 
and  CPT  Gary  Pittman,  DINFOS) :  This  presentation  high¬ 
lighted  the  Defense  Information  School  (DINFOS)  focus  on 
skills  and  knowledges  rather  than  on  tasks.  Presentation 
outline  and  supporting  slides  are  at  Incl  9. 

h.  Air  Force  Survey  Initiatives  for  Soft  Skill  Areas ( 
CPT  Jerry  Barucky,  Occupational  Measurement  Center,  Randolph 
AFFB,  TX) :  CPT  Barucky  discussed  the  professional  military 
education  occupational  survey  project  which  he  conducted 
addressing  the  areas  of  leadership,  management  and  com¬ 
municative  skills.  Supporting  narrative  and  slides  are  at 
Incl  10. 

i.  Soft  Skill  Analysis  Problem  Areas  (CPT  Beqland) : 

The  purpose  of  this  activity  was  to  elicit  the  three  major 


problem  areas  each  service  school  perceived  within  the  area 
of  Soft  Skill  Analysis.  The  problem  statements  addressed 
most  frequently  in  the  "top  three"  areas  were  (see  incl  11): 

(a)  How  do  you  analyze  soft  skills/tasks  (I  2)? 

(b)  How  do  you  write  conditions/standards  for  soft 
tasks  (|  7)7 


(c)  How  do  you  know  a  soft  skill/soft  task  when  you 
see  one  (I  2)7 

j.  Soft  Skill  Analysis  Strawman  Model  (Dr.  R.  Branson, 
Florida  State):  Dr.  Branson  (spokesman  for  the  Scientific 
Support  Personnel  with  whom  OR&A  contracted  to  obtain  sup¬ 
port  in  the  SSA  research  effort)  presented  a  strawman  model 
for  SSA  to  solicit  feedback  from  the  attendees  on  its  appli¬ 
cation  in  the  TRADOC  service  schools.  As  addressed  earlier, 
the  seminar  was  but  one  phase  in  the  SSA  research  effort.  Its 
premise  in  this  phase  was  to  provide  input  to  and  interface 
between  the  SSPs  and  the  service  school  representatives. 
Discussion  generated  during  this  presentation  and  follow-up 
group  sessions  with  selected  attendees  directly  influenced 
the  direction  in  which  the  DRAFT  TRADOC  guidance  will 
proceed  for  SSA.  Backup  slides  for  this  presentation  are  at 
Incl  12. 

k.  Intercommand  Coordination  for  J&TA  TDY  (Dr.  A1 
Longo,  ORAD) :  Dr.  Longo  presented  current  Army  and  TRADOC 
guidance  on  TDY  coordination  (CONUS  &  OCONUS)  Incl  13). 

This  data  was  at  the  request  of  the  previous  seminar  atten¬ 
dees  in  February  on  how  TDY  coordination  should  be  effected. 

l.  Infantry  School  Training  Assistance  Assessment  Team 
at  Ft  Hood  (MAJ  Peter  Stankovich,  Infantry  School):  MAJ 
Stankovich  presented  the  Infantry  School  concept  on  how  to 
manage  and  coordinate  J&TA  survey  requirements  with  FORSCOM 
units.  This  presentation  followed  Dr.  Lonqo's  theme  for 
CONUS  intercommand  coordination.  Supporting  information  is 
at  Incl  14. 

m.  Identifying,  Measuring,  and  Training  "Soft  Skill" 

Competencies  Which  Predict  Performance  In  Professional, 
Managerial  and  Human  Service  Jobs  (Dr.  Lyle  Spencer ,  McBer  & 
Co):  Dr.  Mel  Spehn  (Organizational  F.f  f  ect  ivensss  Training 
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Center:  OETC)  introduced  Dr.  Spencer  and  noted  that  McBer  \ 
Co  are  presently  under  contract  with  OKTC  to  conduct  a  task 
analysis  of  the  Organizational  Bf f ect i vensss  Staff  Officer 
Course  at  Ft  Ord.  Specific  comments  leading  into  Dr. 
Spencer's  presentation  were: 


(1)  How  do  you  train  OESO's  in  soft  skills  which 
they  use  with  their  clients)?  (Note:  They  compose  a  large- 
part  of  both  their  training  and  the  consultant  effort). 

(2)  Early  task  analysis  by" Initial ive  Analysis  of 

♦  Experienced  Professionals"  produced  SH  competencies 

(knowledges  and  skills) . 

(3)  Subsequent  evaluation  of  field  OESO's  indicated 
need  for  4  more  competencies. 

(4)  Initial  analysis  in  traditional  job/task  sense 
proved  (a)  extremely  costly  and  (b)  non-discr iminatory  of 
real  functions  of  effective  OESO's. 

( 5 )  Contract  has  been  made  through  ARI  with  McBer 
Corporation  to  assist  in  task  analysis  of  OESO's.  It  is  now 
in  Phase  I  of  a  four  phase  program  lasting  1  year.  The 
advantages  ot  the  McBer  approach  for  OEC&S  are  (a)  the 
approach  focuses  on  the  personal  characteristics  of  the  OESO 
as  well  as  the  cognitive  tasks  he  does  (b)  the  focus  is  on 
training  to  the  criteria  of  high  achievers  or  most  success¬ 
ful  OESO's  and  (c)  much  work  previously  done  with  the  State 
Dept  and  US  Navy  can  be  used  to  benefit  the  OE  analysis. 


Dr.  Spencer  discussed  an  approach  to  soft  skill  analysis 
that  addressed  competency  analysis  (i.e.,  elements  of  a  job 
vs  people  who  do  the  job  well).  In  essence  it  is  a  method 
to  uTentTfy  the  "super stars , "  survey  these  individuals  on 
how  they  do  their  job,  and  train  personnel  on  these  key 
skills.  Dr.  Spencer's  supporting  slides,  paper  on  this  sub¬ 
ject  and  the  research  McBer  &  Co  conducted  with  the  Navy 
leadership  and  management  training  program  are  at  Incl  is. 

n.  Officer  Common  Task  (Mr.  Steve  Prelewicz,  TDI):  Mr. 
Prelewic*  discussed'  the  RETO  officer  common  task  status, 
findings,  strategy  and  examples.  (Incl 
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o.  Training  Developer  Decision  Aid  (Dr.  Michael  Strub, 
ARI,  Ft  Bliss,  TX) :  Dr.  Strub's  objective  with  this  project 
was  to  develop  a  model  consistent  with  ISD  procedures  to  aid 
the  training  developer  in  the  processes  and  decisions  con¬ 
cerning  what,  where,  and  how  to  train  soldiers  to  perform 
duties.  Inclosure  17  describes  this  presentation. 


p.  TDIS  Status  Mr.  Al  Evans,  ATSC-MISO) :  Mr.  Evans 
discussed  the  current  status  of  the  Training  Development 
Information  System  as  well  as  its  utilization  within  the 
schools.  The  slides  i't  inclosure  18  address  the  key  points 
addressed  in  *nis  information  briefing. 

q.  HumRRO  Job  Aids  for  Use  in  the  Implementation  of  ISD 
(Mr.  Russell  Schulz,  HumRRO'*:  Mr.  Schulz's  presentation  is 
discussed  in  inclosure  19.  This  project  was  conducted  under 
contract  with  ARI  and  was  initiated  at  a  time  no  defined 
procedural  guidance  was  available  within  TRADOC:  before  the 
current  TRADOC  Reg  and  Pam  351-4  were  written.  As  such  some 
data  within  the  DRAFT  versions  of  the  HumRRO  job  aids  differ 
from  current  guidance  in  TRADOC  series  351-4  publication. 

r.  RETO  Implementation  (MAJ  Grover  Josey,  TDI ) :  MAJ 
Josey  a  gave  a  current  overview  of  the  RETO  effort  within 
TRADOC.  Supporting  slides  for  this  presentation  are  at 
inclosure  20. 

s.  Enlisted  Training  Strategy  (MAJ  Steve  Yedinak, 

NCOD) :  MAJ  Yedinak  provided  an  information  briefing  on  the 

TRADOC  Enlisted  Training  Strategy  concept  in  which  each  spe¬ 
cialty  proponent  has  been  held  responsible  for  a  comprehen¬ 
sive  approach  for  enlisted  training  to  insure  all  factors 
that  affect  a  unit's  mission  accomplishment  are  addressed  in 
the  training  progression  for  enlisted  personnel.  Supporting 
slides  for  his  presentation  are  at  inclosure  21. 

t.  Enlisted  Training  Strategy:  Infantry  School  (MAJ 
Peter  Stankovich) :  MAJ  Stankovich's  presentation  was  a 
natural  progression  for  the  previous  ETS  discussion  by  MAJ 
Yedinak.  He  explained  the  CMF  11  progression  strategy  and 
how  it  integrated  with  the  overall  school  strategy.  Support 
data  for  his  presentation  and  the  ETS  briefing  presented  by 
MG  Grange  (CMDT ,  Inf  School)  are  at  inclosure  22. 

u.  Evaluation  and  Analysis  (COL  J.D.  Rockey,  Dir  Eval, 
Trans  School) :  COL  Rockey  addressed  the  link  that  is 
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necessary  in  a  systematic  approach  to  traininq:  Evaluation, 
and  how  it  is  implemented  in  the  Transpor tat  ion  School. 
Supporting  data  for  this  presentation  are  at  inclosure  23. 


v.  TRADOC  Evaluation  Efforts  (Mr.  Don  Bartlett,  Dir  of 
Eval,  TRADOC):  Mr.  Bartlett  presented  the  Headquarters 
TRADOC  perspective  on  their  role  as  evaluators  within  the 
TRADOC  training  development  community  Incl  24). 
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SEMINAR  SCHEDULE 


TIME 

TITLE 

PRESENTOR 

AGENCY 

TUESDAY 

7:30 

REGISTRATION 

SSG  Hale 

ORfirA  Div 

8:00 

TRADOC 

WELCOME 

LTC  Walton 

OR&A  Div 

8:15 

Opening  Comments 

LTC  Walton 

OR&A  Div 

8:45 

Service  School  Perspectives 

CPT  Begland 

ORS.A  Div 

9:15 

BREAK 

9:45 

Expectations  of  Seminar 

LTC  Walton 

10:15 

Discussion 

LTC  Walton 

10:45 

Task  Analysis 

Level  of  Specificity 

John  Brady 

Admin  Cen 

11:15 

AD  CT/File  Selection  SOP 

Gene  Stapher 

Air  Defense 

11:45 

LUNCH 

12:00 

LUNCH 

12:30 

LUNCH 

13:00 

ISD  &  Foreign  Language  Tng 

Paul  Madaresz 

DLI 

13:30 

Job  &  Task  Analysis  vs 
Learning  Analysis 

Mrs.  Mickey  Gan 
CPT  Gary  Pitman 

DINFOS 

14:00 

BREAK 
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Air  Force  Survey  Initiatives 
for  Soft  Skill  Areas 

CPT  Barucky 

OMC,  Randolph 
AFB 

15:00 

Analysis  Problems  in 

Schools 

CPT  Begland 

15:45 

Problem  Prioritization 

CPT  Begland 

16:15 

1st  Day  Concluding  Comments 

LTC  Walton 

16:30 

OPEN 

17:00 

/ 


17:30  HAPPY  HOUR 
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AGENCY 


WEDNESDAY 


8:00 

Review  Previous  Day's 
Activities 

LTC  Walton 

8:30 

STRAWMAN  Model 

Robert  Branson 

Florida  Stat« 

9:00 

N 

9:30 

N 

10:00 

BREAK 

• 

10:30 

Intercommand  Coordination 

Al  Longo 

ORSiA  Div 

10:45 

Infantry  School  Experience 
at  Fort  Hood 

MAJ  Stankovich 

Inf  Sch  t 

11:15 

Job  &  Task  Analysis 
Accountability  in  TRAMIS 

Bob  Durkee 

PRD 

11:30 

LUNCH 

12:00 

LUNCH 
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LUNCH 
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Identifying,  Measuring  & 
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Competencies  which  predict 
performances  in  professional, 
managerial  and  human  services 
jobs . 

Mel  Spehn 

Lvle  Spencer 

OETC 

13:30 

M 

14:00 

Officer  Common  Tasks  (RETO) 

Steve  Prelewicz 

OTSD 

14:15 

BREAK 

14:45 

ARI  Trainer  Developer's 
Discussion  Model 

Mike  Strub 

ARI,  Ft  Bliss 

15:15 

OPEN 

15:45 

TDIS  Status 

Al  Evans 

MISO 

16:15 

OPEN 

18:30 

HAPPY  HOUR 

19:00 

DINNER 
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PRESENTOR 

AGENCY 

THURSDAY 

8:00 

Review  Previous  Day's 
Activities 

LTC  Walton 

8:30 

HumRRO  Job  Aids  for 

Task  Selection  and  Site 
Selection 

Russell  Schulz 

HumRRO 

9:00 

n 

9:15 

BREAK 

10:00 

RETO  Status 

MAJ  Josey 

OTSD 

10:30 

Enlisted  Training  Strategy 
(ETS) 

MAJ  Yedinack 

NCOD 

11:00 

Infantry  School  ETS 

MAJ  Stankovich 

11:15 

n 

11:30 

LUNCH 

12:30 

LUNCH 

13:15 

Evaluation  &  Analysis 

COL  J.D.  Rockey 

Evalulation 
Transpor tat 
School 

13:45 

TRADOC  Evaluation  (HQ 
Perspective) 

Don  Bartlett 

TRADOC  Eval 

14:00 

14:30 

BREAK 

15:00 

Small  Group  Discussion  & 
Seminar  Wrap  Up 

LTC  Walton 

16:00 

16:30 

17:00 

17:30 


ATTENDEES  -  SOFT  SKILL  ANALYSIS  SEMINAR 
14-16  AUGUST  79 


co  r- 

VO 

in 

in 

VO 

rH 

GO 

in 

m  rH  m 

rH 

ro 

ro 

rH 

a 

ON 

C\l  CM  <N 

ro  r-  ro 

rH 

rH 

rH 

m 

ro 

in 

•H 

o 

O'  O'  O' 

tj*  oj 

m  ro 

VO 

ro 

ro 

N  M  (N 

l  I  l 

i 

i 

1 

1 

1 

1 

1 

l 

1 

W  \ 

ov  o\  crv 

H 

rH 

rH 

r** 

00 

CM 

f\i 

o  o  o 

Oi  Oi  <Ti 

r- 

r- 

CO  00 

vo 

in 

in 

in 

r-  r-  r- 

VO  vc  VC 

HT 

vo 

vo 

in 

in 

in 

r-  r-  r- 

VI 

42 

O' 

CO 

VI 

u 

• 

vi 

CO 

CO 

0) 

u 

02 

•rH 

•rH 

X  1-3 

XI 

rH 

to 

Vl  rH  C 

0 

in 

a> 

c 

03 

c 

c 

J£ 

a 

41  rH  TO 

C 

TO 

* 

to:  o>  vi 

•rH 

•H 

TO 

0 

4J 

t-i 

N  <  £ 

U  C 

0 

v. 

0)  TO  41 

VI 

VI 

X 

E 

Vi  0 

C 

to 

•rH  O  O' 

>  (T3  0 

V>  £ 

o 

41  Vi  £ 

u 

Vl 

TO!  W 

Ul 

Vi 

4)  Vi 

<0 

SI 

41  £  TO! 

T3  D  W 

h-I  Eh 

0 

os  c/2  a 

0) 

TO 

C  — ' 

0 

42 

C  CQ 

in 

X  -rH 

A3  'O  C 

u 

OS 

TO 

0> 

W 

TO 

u; 

•VI 

VI 

Vi 

U 

E  Vl 

u  <d  x: 

to 

• 

•  •  VI 

u 

vi  X) 

(0 

(0 

TO  • 

CD 

• 

C  TO  O 

fflH  0 

X  < 

• 

iJ  Q  C/2 

a 

• 

4J  3 

• 

O 

41 

3  EC 

(X 

TO  *rH 

O  1-3 

u 

x 

OS 

CO  kl 

< 

•rH 

• 

£  rH  > 

• 

4J 

(0  TO3  • 

e 

C  -V 

CO 

VI 

VI  >. 

3 

B 

Vl  rH  4) 

CO  £  4J 

• 

a)  ^ 

a>  i-i  w 

03 

0) 

Z  C/2 

VI 

41  W 

CO  c 

to 

41  -rH  3 

0-  u 

Eh 

u» 

a/ 

rH  TO 

•H 

O' 

c 

Vi 

rH 

41  0 

CO 

•rH 

EC  S  S 

C  d)  (1) 

<T3 

D 

W  X  41 

rH 

vi 

TO  01 

42 

U 

>■ 

C  £ 

4) 

rH 

£  co  £ 

• 

cr  £ 

TO  O  C 

rH 

0 

>  2C 

X 

<0 

Vi 

Vl  VI 

E 

rH 

—  ^ 

COO 

u 

TO 

X-H  Cl 

•H 

<1) 

•H 

0  £ 

TO 

TO  C 

TO 

•rH 

*3  l"3  *3 

►3  r)  « 

* 

TO 

£ 

C/2 

u  OS  u 

*  u 

>■£ 

rH 

OS  U  O 

W  < 

•3 

£ 

HI 

•  u  • 

Eh 

13O  • 

• 

• 

rH  • 

U  *3 

• 

•  U 

►3 

Vl  fn  Vl 

< 

E-  Ou 

<  fH  u 

IH 

U 

(0  U 

Eh 

< 

u 

Vi  W 

< 

< 

EKE 

£  ij  £ 

£ 

•J  U 

£  >J  £ 

a 

a 

W  2E 

w 

£ 

£ 

£  C/2 

£ 

2 

OU  (J 

C/2 

£ 

Oh 

O 

<  l 
6h  < 

w  e-> 

Q  Q  Q 
E"  Eh  Eh 
I  I  I 
M  M  M 
N  N  N 

Eh  Eh  Eh 

<  <  < 


| 

Du 

CO  02  Eh 

a 

a 

< 

WWW 

Eh 

a 

< 

< 

U 

O  OS  X 

M 

<£  1 

co  cn 

M 

Eh 

1 

< 

W 

a 

AAA 

i  a 

►J  J 

Q 

a 

a 

i 

Eh  Eh  Eh 

<  <  w 

EH  Eh 

i  i 

Eh 

Eh 

Eh 

3 

OQO 

M  M  Q 

M  1 

u  u 

| 

1 

CO 

1  1  1 

Eh  Eh  Eh 

1  < 

£  £ 

03 

a 

1-3 

■J 

U  C2  U 

<  <  < 

O  02 

X  X 

C/2 

N 

N 

ESI 

02  C/2  C/2 

02  02  C/2 

EH  Eh 

OS  OS 

Eh 

Eh 

Eh 

Eh 

Eh  Eh  Eh 

XXX 

<  < 

a  a 

< 

< 

< 

c 

C  ■<  < 

z  z  z 

WWW 

u  u  u 


WWW 
C22  Cfl  02 

z  z  z 

WWW 

WWW 


z 

a  a  o 

05  X  0 

M 

£  C/2  C/2  C/2 

os «  OS 

S  2  $ 

hh  £  £  a 

a  xxx 

W  M  W 

3  k3 

K  os  2  «  o 

<  <  < 


«c  <  < 


z  z  z 

WWW 

u  u  u 

W  Oh  W 
<  «£  < 
WWW 
CJ  u  u 


GO  O' 

VO 

on 

vo 

o 

CO  \£> 

r- 

CO  rH 

o 

rH 

co  r- 

CO 

ON  CN 

rH 

co 

VO 

1 

<n 

1  1 

in 

i  i 

ON 

1 

ON 

1  1 
in  in 

ov 

1 

o>  o> 

CO 

co  co 

r* 

VO  VO 

VO 

00  00 

00 

CVI 

N 

p 

0) 

H 

H 

£ 

c  c 

JC 

rH 

D 

O 

P  O' 

TO 

SZ 

tyi-H 

3  P 

c 

TO 

N 

£ 

10 

P 

o 

C  > 

E-  P 

(0  c 

X 

tn 

10 

c 

o> 

to 

•n  O 

P 

TO 

O  TO 

1 

TO 

CO 

p 

TO 

p 

r-l  J* 

0) 

•  X 

J* 

P 

01 

8 

rH 

u 

•rH 

TO 

> 

p 

• 

J  C 

c 

X 

p 

3 

c 

•  P 

< 

TO 

P 

£ 

X 

0 

x 

0  TO 

p 

• 

TO 

TO 

0) 

X 

<  p 

•o 

p 

X 

ffi  P 

0) 

TJ  ffi 

rH 

rH 

01 

£ 

•rH 

5 

TO 

• 

• 

rH 

CO 

a 

rH 

u 

X 

p 

P 

TO  0. 

c 

£ 

X 

X 

< 

0) 

rH 

0) 

TO  C 

o 

0) 

£ 

•H 

c 

01 

O'  p 

c 

C  TO 

>. 

P 

a 

P  X 

0  *H 

c 

c 

c 

•H 

(0 

P  01 

TO 

•r<  B 

01 

0) 

rH 

u  p 

P 

3 

c 

0 

•C 

X 

10 

0  P 

(0 

O'  P 

p 

p 

3 

x 

TO  TO 

c 

TO 

>1 

a 

0 

TO 

3 

0)  0) 

3 

0)  0 

•o 

0) 

TO 

0 

£  o 

<  a. 

•J 

•j 

rj 

£ 

a 

U  X 

CO 

X  z 

3 

< 

X 

X 

X 

•  E- 

• 

• 

£-> 

• 

u 

• 

• 

H  »3 

E- 

►3  t* 

1 

• 

• 

<n  x 

U 

u 

a. 

U 

e- 

(0 

U 

X  < 

X 

<  X 

10 

< 

u 

u 

£  U 

Q  Q 

U 

£ 

£ 

£ 

U  £ 

O 

£  U 

£ 

£ 

£ 

£ 

rJ  Q 

E-  < 

M 

<  Eh 

Eh 

Eh 

o  a 

Eh 

CO 

QQ 

1 

M 

M 

1 

M 

1 

z 

1 

X 

^  Eh 

Q 

a 

1  1 

a 

Q 

X 

CO 

Q  Q 

1  1 

Eh 

1 

Eh 

1 

M  M 

1  | 

Eh 

1 

< 

Eh 

| 

£ 

I 

1  1 

X  X 

1 

< 

X 

1  1 

X  X 

1 

M 

1 

CO 

1 

►J 

1 

u 

co  co 

M 

CO 

CO  CO 

CO 

o 

u 

X 

Eh  Eh 

Eh 

Eh 

Eh  Eh 

< 

Eh 

< 

«c  < 

< 

c 

<  < 

< 

>3 

< 

a 

co 

z 

s 

z 

X 

X  X 

u 

X 

u 

Eh  Eh 

XX  Q 

■  M  X 

X 

z 

u 

CO  CO 

CO 

XX  o 

u  u  \ 

u 

w 

X 

o  o 

<  <  X 

CO  CO  u 

J  ij  J 

co 

0 

X 

X  X 

X 

X 

X 

XX  X 

X 

z  z 

H  H  H 

u 

O  Q  £ 

XX  Eh 

Eh  Eh  Eh 

u 

•J 

M  M 

>J  >-)  >J 

z 

>J  >j  5 

z  z  z 

z  z  z 

< 

o 

M 

Q  Q 

a  a  a 

x 

XX  X 

MM  M 

MM  M 

•3 

►J 

£ 

h  o» 

CO 

00 

in  in 

o 

H  H 

in  vc  co 

rH  CN 

m 

in  o 

r- 

ON  O' 

O'  »N»  U‘ 

r-  cn 

o 

vc 

CN  CN 

o  o 

CD  m  %r 

f*>  nr 

1  | 

r* 

I 

CN 

i 

CN  CN 

1  1 

cn 

i 

cn  cn 

i  i 

vr  n  n 

in  in 

O' 

« 

O'* 

1  1 

m  cn 

i 

i  i 

r-  r* 

i  i  i 

o  o  o 

vc  VC 

CM 

00 

CO  CO 

00 

(N  CN 

CO  00  CD 

00  CO 

ON 

CN 

CN  CN 

vc 

ON  ON 

r- 

X 

• 

c 

C  £ 

5 

TO 

> 

0  *■» 

C 

c 

X>  r-t 

rH 

a*  ^ 

in  3 

0 

4> 

Ifl  XI 

3  rH 

4' 

JW  »H 

c  >• 

C  rH 

« 

4) 

u 

•-I  u 

u  4' 

1l 

<0  3 

o  4> 

TO  4' 

X 

14 

4' 

u  w  0 

a  s'. 

Q 

u 

ti  C 

14  C  O' 

14 

3 

O 

O.  10 

li  VU 

in 

(S 

Q  O 

X  4> 

»  -rt  •« 

o> 

>-rc 

Otic 

ID  S  14 

•  m 

(0 

O'  in  4' 

x:  4> 

3 

a* 

c 

• 

0  TO  TO 

an  o 

<  O 

•  X 

a;  u  3 

•  TO  K 

0  c 

in  t> 

£ 

U 

K-*H 

0  3 

• 

Hr 

4'  in 

IX.  14 

j  o> 

<0  14 

4> 

rH  0 

•  tc  in 

>  E 

a 

4> 

•  >i 

0  in 

it 

O  0 

a 

X 

in  .h  jr. 

St 

W  TO 

4’  O 

0.  X  *-' 

*j  a:  4 

to  * 

in 

TO  :* 

10  rH 

0  n 

in 

cn  c 

u 

14  4-H 

•H 

X  44 

fci  >- 

>■  4>  4' 

CTrH 

4> 

14  4< 

X  C  4' 

0>  C  14 

3  c 

ftl  -H 

rH 

Wl 

0  >.  u 

14  H  N 

4>  rH 

i. 

O  14 

o  £  X) 

X>  TO  TO 

0  TO 

14  rH 

a* 

a> 

£  Q  TO 

TO  TO  TO 

14  -rt 

TO 

4'  4' 

TOCO 

Q  >  £ 

j  a 

&4  U 

X 

o 

o  >3  rc 

l?  S 

no  h 

n  *->  a 

4h(i 

• 

•  • 

• 

f-*  1-  H 

K  f.,  l-j 

.  O 

x  e> 

•  •  U 

•  •  • 

U  M 

Wl 

«4* 

a.  a. 

«r 

u  in 

0  UJ 

14  14  t' 

w«  u  u 

U  X 

X  X 

a 

A 

O  U  rH 

£  o  x 

X  in 

£ 

in  X 

J!Xr) 

Q  X  Q 

tant  Dr.  Charles  Peigeluth 


ON 

o> 

CD 

00 

00 

rH 

^H 

CO 

o 

o 

<  > 

V ) 

o 

H 

rH 

CN 

o 

o 

VP 

VP 

VP 

VP 

VP 

(N 

CN 

VP 

o> 

CO 

| 

co 

i 

CO 

1 

CO 

i 

CO 

1 

CO 

1 

CO 

l 

VP 

00 

00 

1 

o 

i 

o 

1 

o 

i 

o 

1 

o 

1 

V  ' 

1 

o 

1 

r- 

VP 

1 

VP 

00 

CO 

cr> 

c\> 

CP 

00 

00 

00 

CO 

CO 

VP 

VP 

VP 

VP 

VP 

VP 

VP 

CN 

CN 

cr 

cr 

Vl 

c 

4) 

> 

■H 

c 

0  XI 

N 

JC 

c 

u 

0 

T3 

O'  vi 

a 

u 

s 

a*  c 

4-> 

c 

C  4) 

-r-i 

c 

CJ 

c 

n 

<-<  41 

»-H 

<0 

0  > 

>  3 

c 

VI 

rH 

Vi 

j* 

4i  Vi 

43 

H 

ij  r-t 

4' 

4' 

10 

<0 

rH 

A 

a1 

4)  4' 

cn  c 

S 

cr 

41 

to 

»H 

3 

CD 

0> 

a* 

£  Q 

•-<  0 

4) 

k  H  U) 

0 

41 

cr. 

3 

JC 

E 

5  c 

>  cn 

•D 

CD 

4>  m 

r> 

Vi 

• 

o 

O 

cn 

<o 

ns  Xi 

u 

*0  K  T3 

Cl. 

10 

X 

u 

•H 

•u  > 

a  — « 

O 

•U 

C  Vi 

Vi 

4' 

e> 

Vi 

• 

Vi 

o 

UJ 

u 

(0  >1  <0 

4) 

4) 

rH 

> 

4> 

u 

41  .* 

>, 

TD 

4) 

X  u  c 

> 

> 

Vi 

VI 

• — i 

•D 

X!  U 

T3  >. 

<0 

•O 

4’  Vi  Vi 

0 

4' 

10 

Vi 

4' 

4> 

• 

0  "H 

C  ki 

Vi 

Q 

H  11  tl 

VI 

4J 

x: 

4> 

0 

VI 

u. 

a  a 

<  43 

X 

• 

CD 

« 

<  <->  a 

U 

cn 

u 

•D 

(V 

f-J  t-  • 

u 

Eh 

•  O  • 

*1 

• 

• 

e 

r-. 

< 

O/  w 

V  10 

Eh 

a 

Vi  W  Vi 

< 

U 

U 

a 

x 

U  X 

X  X 

.J 

u 

a  cn  x 

X 

X 

X 

u 

X 

X 

< 

a  a 
to  cn 

s 

Eh  Eh 

o 

o  o 

Q  O 

OS  W  W 

i 

1  1 

<  < 

a  i  i 

M 

M  M 

Eh  Eh 

1  u  u 

Q  Q  Q  C  < 

Q 

Eh 

a  a 

Eh  Eh 

ll 

H  Eh  H  Q  O 

1  1  1  1  1 

1 

O 

1  1 
o  O 

Eh  Eh 
1  1 

Eh  Eh  Eh  Eh  Eh 

z 

z  z 

D  D 

V)  V)  cn  to  CD 

Eh 

Eh  Eh  Eh 

cn  cn 

Eh  Eh  Eh  Eh  H 

Eh 

Eh  Vl  M 

Eh  Eh 

«*«£<<< 

< 

<  <  3 

<  < 

u 

U 

. — . 

rH  rH  rH  rH  rH 

u 

8  8  8  8  8 

Eh 

a 

X 

o 

<  3 

■c  x:  x:  x:  jc 

cn 

X  X 

o  o  o  u  o 

a 

M  IH 

cn  cn  cn  cn  cn 

1-1  M  M  M  M  M  M 

O 

2 

C  < 

0  0  0  0  0  0  0 

z 

cn 

cn  cn 

Eh  Eh  Eh  Eh  Eh 

Eh  Eh  Eh  Eh  Eh  Eh  Eh 

P 

D 

D  D 

3-1 


IBIS  PAG£  IS  BiJl  QUALITY  PKA^IftA  B]J 

FROM  COPY  Jtt*jUSK3L  TO  LDO  _ 


SOFT  SKILL  ANALYSIS  MILESTONES 


3 

Q 

UJ 

I 

O 

co 


, _ _ 

o 

00 

o 

r>* 

o 

O 

> 

o 

m 

_ _ N 

p— 

00 

00 

u_ 

w 

O' 

Q  £ 

m  (r 

> 

o  3 

1 1 1 

»/> 

3 

o 

>- 

u. 

> 

cl 

oc 

>— 

> 

u. 

K 

£  -* 

3 

. 

* 

a 

oc 

UJ 

-J  UJ 
£  2 

£  « 

< 

oc 

H- 

O 

oc 

»— 

o 

a 

<N 

o 

o 

►— 

O 

5  3 

5  o 

00 

00 

O  3 

0~ 

• 

►— 

CO 

h- 

CO 

J— 

CO 

> 

> 

X 

h- 

u 

u 

- 

u. 

u_ 

% 

Z 

UJ 

> 


co 

L 

o 

CO 

z 

o 

CO 

Z 

o 


QC 


5 

3 

co 

O 

Ql 

5 

> 

CO 

co 

co 

> 

< 

Z 

< 


QC 

< 

z 


vo 

v/) 
> 
— j 

< 

Z 

< 


CO 


CO 

(/) 

UJ 

o 

at 

Q. 

CO 

CO 

> 


< 

Z 


CO 

►- 

Z 

UJ 

s 

z 


3 

Q 

o 

2 


u 

O 

o 

< 

OC 

£ 

z 

o 


U.  mmm 

KT> 

6  ^ 

CO 

_j 

co 

o  « 

co  a 

CO 

UJ 

H- 

co 
> 
_ 1 

> 

UJ 

oc 

-J  b- 

O 

Z 

UJ 

3 

0. 

si 

UL 

►— 

u. 

t  OC 

<  o 

< 

< 

Z 

a 

tz  < 

z 

_j 

< 

<J  < 

o 

o 

OC  LL 

< 

UJ 

o  > 

a 

Z 

CO 

CO 

</) 

Q 

A. 

CL 

CO 

>— 

u 

— 

c 

> 

CO 

> 

«s 

> 

CO 

> 

o 

> 

> 

uia  uj 

UJ 

UJ 

UJ 

UJ 

UJ 

UJ 

UJ 

UJ 

uofl  co 

CO 

CO 

CO 

CO 

CO 

CO 

VO 

VO 

<3  < 

< 

< 

< 

< 

< 

< 

< 

< 

i  i 

X 

X 

X 

X 

X 

X 

X 

X 

a.9  a. 

a. 

CL 

a. 

CL 

CL 

a. 

CL 

a. 

THIS  Piej!  u  BIST  QUALITY  PRACriUAKLl 

PROJJ  CD?Y  r\Jt  KiSLSL  TO  DOC  '• 


3-4 


THIS  PAM  VS  BAST  QUAMW 
FROil  90? T  #W*ilSHBD  10  DDO 


QUjiiiry 

80  TO  ODO 


SHOULD  BE  COMPLETED  BY  ALL  PERSONNEL  INVOLVED  IN  DOING  OR 
EVALUATING  JOB  AND  TASK  ANALYSIS 


SERVICE  SCHOOL  PERSPECTIVES 


Introduction: 

This  initial  presentation  was  intended  to  inform  the  seminar 
participants  as  to  the  status  of  the  ongoing  research  ini¬ 
tiative  into  soft  skill  analysis.  The  discussion  attempted 
to  relate  previous  efforts,  i.e.,  ARI ,  HumRRO ,  USCONARC  Soft 
Skill  Conference,  civilian  research,  etc,  with  the  present  progam. 

Specific  Comments: 

The  symposium  conducted  at  the  JAG  school  during  previous 
month  was  described  and  its  purpose  specified. 

The  purpose  of  this  seminar  was  described  and  the  underlying 
philosophy  behind  the  soft  skill  project  explained. 

The  primary  focus  of  this  presentation  related  to  the  ser¬ 
vice  school  replies  to  a  TDI  message  asking  each  school  to 
describe  the  soft  skill  areas  within  each  of  its  spe¬ 
cialties.  These  replies  have  been  integrated  into  a  matrix 
of  soft  skill  functional  categories  (incl  1),  these  cate¬ 
gories  were  then  analyzed  by  service  schools  (incl  2  and  3), 
and  then  this  data  compared  against  the  present  list  of 
officer  common  tasks  (incl  4).  This  data  showed  that  there 
are  substantial  differences  or  perceptions  within  each  of 
the  service  schools  concerning  what  soft  skills  are. 

Within  several  school  responses  there  were  detailed  comments 
conceiving  observations  about  soft  skill  analysis.  Several 
of  these  comments  were  discussed  (incl  5,  6,  7).  It  was 
noted  that  several  school  comments  were  supportive  of  the 
findings  at  the  soft  skill  symposium. 

CONCLUSION: 

The  purpose  of  this  brief  review  of  the  school  replies 
(copies  of  which  were  distributed)  was  to  introduce  the  soft 
skill  analysis  project  in  the  context  of  the  seminar  and 
other  initiatives.  The  school  replies  showed  the  variety  of 
functional  categories  perceived  to  be  a  soft  skill  area. 

Through  this  introduction,  later  presentations  could  be 
viewed  in  context. 
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IS  ANOTHER.  THE  VERY  LACK  OF  CONTINUITY  OR  CONSISTENCY 
OF  STANDARDS  FOR  SOFT  SKILL  AREAS  MAY  WELL  BE  THE  FOCUS 
OF  STUDY. 


THE  OVERT  (BEHAVORIAL)  STEPS  A  SOLDIER  PERFORMS.... 


SOFT  SKILL  CATEGORIES 


1  AMMUNITION 

2  AWARDS  &  PUNISHMENT 

3  COMMUNICATIONS 

4  COUNSELLING 

5  COUNTERTERRORISM 

6  COVER/CAMO/COUNCEAL 

7  CREATIVE 

8  CRIMINAL  INVESTIGATION 

9  CRIME  PREVENTION 

10  DEMOLITIONS 

11  DISCIPLINE  LAW  &  ORDER 

12  DISMOUNTED  DRILL 

13  ESCAPE/EVAS ION /SURVIVAL 

14  EVALUATION 

15  FIELD  SANITATION 

16  FIRE  REQUESTS 

17  FIRST  AID 

18  HUMAN  RELATIONS 

19  INSPECTIONS 

20  INTELLIGENCE/COUNTER 

21  INTERPERSONAL 

22  JUDGMENTAL 

23  LAND  NAVIGATION 

24  LEADERSHIP 

25  LEGAL/ETHICAL 

26  MAINTENANCE 

27  MANAGING 

28  NBC 

29  OBSTACLES/MINES 

30  PERSONAL  HYGEINE 

31  PERSONNEL 

32  PHYSICAL  FITNESS 

33  PHYSICAL  SECURITY 

34  PLANNING 

35  PRISONER  OF  WAR  OPER 

36  PROFESSIONALISM 

37  PUBLIC  RELATIONS 

38  SAFETY 

39  SUPERVISION 

40  SUPPLY 

41  TACTICAL  EMPLOYMENT 

42  TECHNICAL/MOS 

43  TRAINING 

44  UNIT  ADMINISTRATION 

45  VEHICLES 

46  WEAPONS 
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•  PERCEPTIONS 

•  STRAWMAN  FEEDBACK 

©PERMITS  PRESENTATION/DISCUSSION  ON  ISSUES  SURFACED 
DURING  LAST  SEMINAR  AND  THOSE  GENERATED  SINCE  THAT 


guwn  ruH»“*K'* 

to  DDC 


(COMMENTS  FROM  SCHOOLS  VALIDATING 

AND 

SCHOOLS  USING  DRAFT  CHAPTER  9  (TBP)  ) 


CATEGORIES  OF  "SOFT-SKILL"  TASKS 

I.  INTERPERSONAL  TASKS 

II.  JUDGMENTAL  TASKS 

III.  CREATIVE  TASKS 


Involves  interaction  between  two  people 
Is  intended  to  influence/change  behavior, 

ATTITUDE  OR  OPINION 


EXAMPLES  OF  INTERPERSONAL  TASKS 


Counsel  subordinate  on  work  performance 
Conduct  sales  interview  (recruiting) 

Interview  prospective  employee 
Brief  newly  assigned  personnel 
Establish  individual  performance  objectives 
Conduct  an  interview  for  a  news/feature  story 
Counsel  a  soldier  charged  with  UCMJ  offense 
(Advise  client) 


PROBLEMS  WITH  INTERPERSONAL  TASKS 


+  Innumerable  initiating  cues 
+  People  are  themselves  conditions 
+  Internal  cues  vary  infinitely,  affecting 

THE  WAY  THE  TASK  SHOULD  BE  PERFORMED 

+  Difficult  to  measure  change  in  behavior, 

ATTITUDE,  OR  OPINION  IMMEDIATELY  AFTER 
TASK  PERFORMANCE 


c  * 


Involves  identification  and  consideration 

OF  COUNTLESS  INTERRELATED  VARIABLES 

Involves  use  of  individual  logic  to  arrive 

AT  JUDGMENT 

Judgment  cannot  be  evaluated  as  wholly 

CORRECT  OR  INCORRECT 


EXAMPLES  OF  JUDGMENTAL  TASKS 


Plan  your  daily  work  schedule 

Prepare  an  assessment  of  the  human  situation 

Evaluate  the  assessment  of  the  human  situation 

Prepare  a  budget 

Approve/Disapprove  expenditures 

Evaluate  subordinate's  performance 

Select  an  employee  from  among  "best  qualified" 

Select  tasks  for  training 

Assign  priorities  to  missions/tasks 


PROBLEMS  WITH  JUDGMENTAL  TASKS 


+  Conditions  vary  extensively 
+  Each  manager  is  unique 
+  Each  manager  works  within  a  unique 

FRAMEWORK  OF  EXTERNAL  INFLUENCES 

+  Qualified  evaluators  will  disagree 

ON  THE  ADEQUACY  OF  TASK  PERFORMANCE 
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ChARACIEmSIl.CS. . QL  IhE  CREATIVE  TASK 


+  Multitude  of  variables  (purposes,  concepts, 

METHODS,  MEDIA,  AUDIENCES) 

+  Conditions  vary  infinitely 

+  Procedures  vary  infinitely 

+  Standards,  for  the  most  part,  are  highly 
SUBJECTIVE 
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EXAMPLES  OF  CREATIVE  TASKS 


+  Write  a  military  letter 
+  Write  a  feature  story 
+  Layout  a  magazine/newspaper  page 
+  Edit  a  photograph  for  reproduction 
+  Edit  a  task  summary  (SM  page) 

+  Design  a  blank  form 

+  Design  an  instructional  module 

+  Write  a  TV  spot/promotional  announcement 


\ 
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PROBLEMS  WITH  CREATIVE  TASKS 


+  Every  creative  product  is  unique 
+  Every  repetition  of  a  particular  task  is  somewhat 

DIFFERENT 

+  NO  TWO  PERFORMERS  WILL  PRODUCE  EXACTLY  THE  SAME 
PRODUCT 

+  NO  KNOWN  PROCEDURE  WILL  ALWAYS  PRODUCE  AN  ACCEPTABLE 
PRODUCT 

+  "Experts"  will  disagree  on  the  acceptability  of 

MANY  PRODUCTS 
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TASK:  Conduct  performance  counseling  with  a  subordinate 


PERFORMANCE  STEPS: 

1.  Read/Reread  FM  22-100  and  FM  22-101, 

2.  Gather  data  on  the  soldier's  actual  performance, 

3.  Compare  the  actual  performance  data  with  the 
soldier  s  individual  performance  objectives. 

4.  Develop  a  performance- improvement  plan. 

5.  Select  and  schedule  a  counseling  site. 

6.  Set  up  the  counseling  site. 

*  7.  Conduct  the  counseling  session. 

8.  Schedule  the  next  counseling  session. 

9.  Make  a  written  record  of  the  session. 

10.  Provide  follow-on  assistance. 


GUIDELINES  FOR  COUNSELING 


+  Try  to  set  the  subordinate  at  ease 
+  Convey  your  purpose--to  help  the  soldier 

IMPROVE  OR  MAINTAIN  HIS  PERFORMANCE 

+  Protect  the  soldier's  right  to  privacy 
+  Ask  for  questions/problems 
+  Deal  with  specifics,  not  generalities 

+  Do  MORE  LISTENING  THAN  TALKING 

+  Be  alert  to  nonverbal  feedback 

+  Avoid  evaluating  the  soldier's  character 

+  Compare  actual  with  required  performance 

+  Where  possible,  discuss  performance  in 
measurable  terms— quantity,  quality, 
timeliness,  etc. 

+  Stress  points  of  improvement,  not  deficiencies 
+  Look  for,  and  remove,  performance  barriers 

THAT  ARE  BEYOND  THE  SOLDIER'S  CONTROL 

+  Determine  if  you  are  part  of  the  problem 

+  If  YOU  ARE  PART  OF  THE  PROBLEM,  SEEK  WAYS  TO 
CORRECT  THE  SITUATION 

+  Seek  the  soldier's  own  ideas  for  improvement 

+  Provide  specific  guidance  for  improvement 

+  Refer  the  soldier  to  an  appropriate  agency 
if  his  problem  is  personal  or  emotional 
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CONCLUSIONS 


+  Task  identification  is  relatively  easy 
+  Specification  of  conditions  is  difficult 
+  Specification  of  standards  is  difficult 
+  Accounting  for  all  possible  cues  is  impossible 
+  Analysis  in  general  terms  (typical  cues,  broad 

CONDITIONS,  VAGUE  STANDARDS,  GENERIC  PROCEDURES) 
IS  POSSIBLE 

+  Guidelines  (dos  and  don'ts)  for  task  performance 

CAN  BE  DEVELOPED 

+  Testing  generalities  is  very  difficult 
+  Skills  and  knowledges  can  be  identified 
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USAADS 


STANDARD  OPERATING  PROCEDURES 
FOR  THE 

SELECTION  OF  CRITICAL  TASKS 
AND  TRAINING  SITE 


Prepared  by: 

Training  Analysis  and  Design  Divisior 

"  IprtTm,0'  Ir*1"ln« 


1.  i\'ui  .->1  .  ".v  <  -t.ililii.il  a  Sta  Jperating  Procedure  (SOP) 

used  at  liSAADS  for  the  selection  of  critical  tasks  and  training  si 
To  satisfy  ;’e  SOP  l oqairement  established  by  TRADOC  Regulation  351-4, 

Job  and  Task  Analysis,  dated  9  March *1979. 

2.  APPLICATION.  These  procedures  are  applicable  to  all  critical  task 
selerf-inr.  vMons  undertaken  by  the  Directorate  of  Training  Developments, 

USA.-D". 


3.  BACKGROUND.  It  is  a  recognized  fact  there  is  no  100  percent  correct 
way  of  selecting  critical  tasks  for  training.  The  procedures  in  this  SOP 
represent  those  most  advantageous  to  USAADS  in  teres  of  using  available 
resources  a-vl  capabilities  to  produce  the  best  possible  listing  of  criti¬ 
cal  tasks. 


4.  PRECEDEi.Cl.  It  is  the  intent  of  this  SOP  to  comply  with  the  require¬ 
ments  of  TRADOC  Regulation  351-4,  Job  and  Task  Analysis,  and  to  apply  the 
procedures  described  in  TRADOC  Pamphlet  351-4,  Job  and  Task  Analysis 
Handbook.  In  case  of  conflict,  the  TRADOC  regulation  and  pamphlet  (cited 
above)  take  precedence.  Conflicts  will  be  reported  to:  Director,  Direc¬ 
torate  of  Training  Developments  (ATTN:  Chief,  TAD),  US  Army  Air  Defense 
School,  Fort  Bliss,  Texas  79916. 

5.  PROCEDURES. 

a.  USAADS  critical  task  selection  worksheet. 

(1)  The  final  task  inventory  will  be  listed  on  critical  task 
selection  worksheets.  Project  analysts/subjcct  matter  experts  will  com¬ 
plete  .the  forms.  Judgement,  entries  will  represent  the  consensus  of  the 
project  analysts. 

(2)  The  worksheet  construction  is  derived  from  a  logic  flow 
chart.  V.’hen  completed  the  worksheet  will  produce  for  each  task: 

-  A  tentative  decision  on  task  criticality.  (Critical: 

Tes  in  Mo) 

A  tentai  ive  decision  on  training  site.  (Resident  or 

Extension) 

-  A  tental.'ve  decision  on  the  relationship  of  the  task  to 
collective  mission  tasks  and  the  Army  Training  and  Evaluation  Program, 
(ARTEP  Task:  'Yes  or  No) 

A  tentative  decision  on  the  task  as  a  required  wartime 
training  task  (WTT) .  (WTT:  Yes  or  No) 

(3)  A  worksheet  annotated,  with  instruction  is  at  Annex  A, 


THIS  PAGX  IS  SgjT  QUALITY 
FROM  30PY  »UA*ISHJKD  ID  i>D0  - 


I 


Setting 


Dimensions  of 


1 


(4)  A  blank  worksheet  is  at  Annex  B. 

(5)  The  logic  flow  chart  supporting  the  decisions  derived  from 
completing  the  worksheet  is  at  Annex  C. 

b.  The  Critical  Task  Selection  Board  (CTSB). 

(1)  The  purpose  of  CTSB  is  to  review  the  data  and  recommendations 
submitted  by  the  project  analysts  and  to  make  informed  judgements  concern¬ 
ing  the  criticality,  training  site,  AKTEP,  and  VTT  recommendations  devel¬ 
oped  by  the  project  analysts, 

(2)  The  CTSB  will  be  composed  of  informed,  experienced  members. 
The  CTSB  will  include  at  least  five  and  no  more  than  eight  members.  Board 
members  may  be  drawn  from  the  following  sources  in  the  number  indicated: 

AGENCY  MAXIMUM  (i  OF  MEMBERS 


-  Directorate  of  Evaluation  (2) 

-  ARTEP  Branch,  TADD,  DTD  (I) 

-  Design/SM  Branch,  TADD,  DTD  (1) 

-  Course  Development  Division,  DTD  (1) 

-  Directorate  of  Training  (2) 

-  MOS  incumbents  from  TOE/TDA  units  (2) 

-  Chief,  TA  Branch,  TADD,  DTD  (1) 


(3)  Project  analysts  will  serve  the  CTSB  as  facilitators-  In 
this  capacity,  responsibilities  include  briefing  CTSB  members  concerning 
command  guidance,  parameters  of  the  CTSB  duties  and  responsibilities,  and 
upon  request,  an  explanation  supporting  rationale  used  to  support  subjec¬ 
tive  judgements.  Additionally,  analysts  will  record  sufficient  data  con¬ 
cerning  CTSB  members,  qualifications  and  board  proceedings  to  support  an 
audit  trail. 

(4)  The  CTSB  chairperson  will  be  selected  by  the  CTSB  members 
at  the  first  meeting.  To  insure  freedom  of  expression,  it  is  important 
that  chairperson  allow  all  reasonable  arguments  to  be  heard. 

(5)  A  simple  majority  will  normally  resolve  disputes  arising 
during  CTSB  decisions/procedures.  Disputes  not  settled  by  CTSB  will  be 
referred  to  the  Chief,  TAD,  by  the  chairperson  for  arbitration  and  final 
resolution. 
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(0)  At  least  two  weeks  i>  v..-  to  first  meeting,  Cl'SB  me  be; o  wail 
bo  provided  with  completed  copies  of  USAADS  critical  task  selection  work¬ 
sheets  concern i o'*  rho  \ oh onP  *  -slderntion.  CTSB  membct  u 

thi  ti  to  it...1  aally  review  /disagree)  with  the  rcccrv  ri 

oi feii'J  for  each  task  and  prepare  .juiuaale  supporting  disagree;  •). 

(7)  The  CTSB  will  be  convened  upon  request  of  the  Chief,  Training 
Analysis  Branch,  TAD  Division,  DTD,  USAADS. 

c.  A  flow  chart  of  the  complete  task  selection  process  is  at  Annex  D. 
In  addition  to  the  events  already  discussed,  it  includes  necessary  pre¬ 
paratory  and  terminal  events. 

ANNEX  A  -  Worksheet  Annotated  with  Instructions 

# 

ANNEX  B  -  Blank  Worksheet 

ANNEX  C  -  Lo{ ic  Flowchart  Supporting  Decisions 

ANNEX  D  -  Flowchart  for  Complete  Task  Selection  Process 

ANNEX  E  -  Glossary  of  Terms 
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*  SIX  CRITERIA 
I*  Number  Performing 
2»  Tima  Spent  Performing 
3»  Consequence  of  Inadequ. 
Performence 
Tesk  Delay  Tolerance 

5.  Task  Learning  DifficuH 

6.  Task  Freeur.  -  -•/ 
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GLOSSARY 


CONSENSUS  CROUP 

A  k i  of  personnel,  selected  for  their  experience  and  knowled;  o  ol  the 

Joh  and  training  technology,  brought  together  to  organise,  analyse,  and 
record  task  related  data. 


00NSK^lH  Na;s  OK  INADEQUATE  PERFORMANCE 


This  criterion  addresses  the  results  of 
mance  of  a  task  when  the  performance  is 

v.wy  result  in  injury  to  personnel,  loss  . . . . v„  , 

Inadequate  performance  could  have  a  serious  impact  on  mission,  the  opera¬ 
tion,  the  product,  the  equipment,  or  the  operator.  The  delineations  and 
weighting  are: 


Inadequate  (deficient)  perfor- 
needed.  Inadequate  per  ormunce 
of  life,  or  damage  to  equipment. 


6  -  Most  Serious  (disastrous)  Consequences 
5  -  Serious  Consequences 
4  -  Moderately  Serious  Consequences 
3  -  Minimal  Consequences 
2  -  Trivial  Consequences 
1  -  No  Consequences 

CRITICAL  TASK 


A  critical  task  -  a  soldier's  manual  task  ■  a  task  selected  for  training 
(regardless  of  site  selection).  It  is  a  task  which  is  essential  for: 
accomplishment  ol  the  unit's  mission  or  successful  Individual  Joh  per¬ 
formance  or  survivability  in  a  combat  situation. 

CRITICAL  TASK  SELECTION  HOARD 

A  board  composed  of  informed,  experienced  members  convened  to  review  the 
task  inventory  and  the  task  criticality,  training  site,  ARTEl’ ,  and  WTT 
recommendations  submitted  by  the  training  analyst s/suhject  matter  con¬ 
sensus  group.  When  the  board  does  not  agree  with  the  recommendations 
submitted  to  it,  it  will  provide  alternative  recommendations. 

NUMBER  PERFORM! NO 

This  criterion  is  the  number  of  Job  incumbents  who  perform  the  task. 

The  delineations  and  weighting  are: 


5  -  Many 

4  -  Some 

3  -  Few 

2  -  Minimal  Number 

1  -  Nona 

TASK 

A  task  can  bo  loosely  defined  ns  the  lowest  level  of  behavior  In  a  Job 
that  describes  tbe  performance  of  n  meaningful  function  In  the  Job.  A 
tnsk  enn  lave  tbe  following  characteristics: 

a.  A  task  Is  a  statement  of  a  highly  speclftc  action. 

b.  A  task  has  a  definite  beginning  and  end. 

c.  A  task  Is  performed  In  a  relatively  short  period  of  time. 

d.  A  task  Is  measurable. 

c.  In  the  eyes  of  the  Job  holdov,  a  task  is  performed  for  its  own 
sake. 

TASK  OKI  AY  TOT  .FRANCE 

Task  delay  tolerance  is  a  measure  of  how  much  delay  (time)  can  he  tol¬ 
erated  between  the  time  the  need  for  performance  of  the  task  (cue) 
becomes  evident  and  the  time  actual  performance  must  begin.  The  delin¬ 
eations  and  weighting  are:  * 

6  -  Least  Tolerant  (Tank  must  ho  performed  immediately  whenever  it 

is  required.) 

5  -  Minimal  Tolerance 

4  -  Moderately  Tolerant 

3  -  Tolerant 

2  -  Very  Tolerant 

l  -  Extremely  Tolerant  (There  is  very  little  need  for  Immediate 
performance.) 

TASK  FREQUENCY 

This  criterion  addresses  how  often  the  task  is  performed.  The  delinea¬ 
tions  and  weighting  are: 


6  -  Several  Times  Dally 
5  -  Oner  Daily 
A  -  Once  a  Week 
3  -  Once  or  Twice  n  Month 
2  -  Infrequently 
1  -  Never  Performed 

TASK  LEARNING  DIFFICULTY 


This  criterion  addresses  the  time,  effort  and  assistance  required  to 
achieve  task  performance  proficiency.  The  delineations  and  weighting 
are: 

6  -  Extremely  Hard  to  Learn  (Training  Essential) 

5  -  Hard  to  Learn 

4  -  Somewhat  Hard  to  Learn 

3  -  Easy  to  Learn 

2  -  Very  Easy  to  Learn 

1  -  Common  Knowledge  (No  Training  Required) 

TIME  SPENT  PERFORMING 

This  criterion  is  the  amount  of  time  the  job  incumbent  spends  performing 
this  task  in  relationship  to  other  tasks.  The  delineations  and  weighting 
are : 

6  -  Very  Much  Above  Average  Time 

5  -  Above  Average  Time 

4  -  Slightly  Above  Average  Time 

3  -  Average  Time 

2  -  Belov  Average  Time 

l  -  Very  Much  Below  Average  Time 

TRAINING  SITE  SELECTION 

The  determination  as  to  where  a  critical  task  will  be  trained:  Resident 
or  non-resident  (extension) . 

WARTIME  TASK 


A  task  which  is  performed  in  combat. 
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KEY  TO  ABBREVIATIONS 
VP  -  Verb  phrases 

VP  (inf)  -  Verb  phrases  with  infinitive 
NP  -  Noun  phrases 
TA  -  Time  adverbs 
SA  -  Spatial  adverbs  (locative) 

AQ  -  Adverbs  of  quantity 


8-2 


1.  Interviewing _ 

*•  Establish  Rapport 

a.  Greet  interviewee 

b.  Make  Introductory 
remarks. 

c.  Carry  on  limited 
small  talk. 

2.  Conduct  Business 

a.  Establish  identity 
of  interviewee. 

b.  Identify  himself 
in  his  official 
capacity. 

c.  Explain  the  nature 
of  interview. 

d.  Ask  questions  on 
topics  selected. 

e.  Take  notes  of 
answers. 

f.  Ask  for  further 
details,  explana¬ 
tions,  clarifica¬ 
tions  as  needed, 

3.  Terminate  Interview 

a.  Thank  for  the 
cooperation. 

b.  Set  up  new  time, 
location  for  the 
next  interview 
(if  applicable). 

c.  Say  good-bye. 


.  rai  ticipants/ 

1  Stimuli 


(.  Ethnic  origin: 

-  ethnic  Germans 

I.  Legal  Status: 

-  refugees 

-  deserters 

-  political 

dissidents 

2 

J.  Place  of  origin: 

-  East  Germany 

-  The  Soviet  Union 

-  East  European 
countries 

4.  Languages/dialects 
spoken: 

-  East  German 

-  Volga  German 
dialect 

-  Other  German 
dialects  of 
Eastern  Europe 

-  Standard  German 
(Hochdeutsch) 

-  Russian,  Polish, 
and  other  Eastern 
European  languages 

5.  Socio-political 
background : 

a.  Social  Status 

-  farm  workers 

-  factory  workers 

-  members  of 
intelligence 

-  members  of  former 
social  classes 

b.  Political  affilia¬ 
tions 

-  Communist  Party 

-  Communist  Youth 

Organizations 

-  Trade  Unions 

-  Non-members 

6.  Level  of  education/ 

training 

-  from  elementary  to 

post  doctoral 
education 

-  all  types  of  voca¬ 

tional  training 

7.  Civilian  occupations 

-  farmers  (agricultural 

laborers) 

-  factory  workers 

-  artisans 

-  manages 

-  government  employees 

-  professionals  I 

-  artists  I 

-  1  - 


1.  Role  set  identity 

-  Individual  to 
individual 

-  adult  to  adult 

-  male  to  male 

-  male  to  female 

-  female  to  male 

-  young  to  old 

-  old  to  young 

-  same  age 

2.  Types  of  Role 


a.  psychological 

roles 

-  equality  ■; 

-  neutrality 

-  empathy 

-  sympathy 

-  cooperation 

-  persuation 

-  direction 

-  suspicion 

b.  Social  roles 

-  stranger  to 

stranger 

-  official  to 

private  persdn 

-  friend  to  | 

friend,  etc.  I 


1.  Linguistic 
Interaction 

a.  Types 

-  face-to-face 
comnunicatioiv 

-  over  the  phone 

b.  Language  skills 

required 

-  conversational 
language 
‘speaking (40*) 
‘listening (60%) 
‘note  taking 

■2.  Cultural  interaction 

-  use  of  "body 

language" 

-  use  of  culturally 
appropriate 
expressions 


CONDITIONS 


Setting 


1.  Spatial  arrangements 

a.  Location: 

-office  in 

barracks 

-Office  in  other 
locations 

b.  Unusual  circum¬ 
stances 

NONE 

2.  Temporal  factors 

a.  Peacetime 

b.  Time  of  Job  per¬ 
formance  : 

-all  hours  of  the 
day 

c.  Duration: 

-As  much  time  as 
required 
(Usually  2-3 
hours  sessions 
repeated  as  needed) 

Frequency: 

-several  times 
weekly 

3.  Psychological 
factors 

Atmosphere 

-friendly 

-cooperative 

-relaxed 

-strained 

-tense 


Dimensions  of 
Performance 


Size  of  utterances 

a.  Questions  asked 
by  interviewer 
-from  short 

phrases  to  1-2 
sentences 

b.  Answers  given  by 
interviewee 
-from  phrases  to 
discourse  (short 
paragraphs) 

Range  of  language 
use 

a.  Registers 
-formal  (mostly) 
-informal 

b.  Styles 

-casual /colloqui¬ 
al 

-conventional 

-deliberative/ 

sophisticated 

c.  Special  features 
-professional/ 
military  Jargon 
-up-to-date 
language 

-slang  expressions 
-dialects  (only  for| 
comprehension) 

Complexity 

a.  Sentence  con¬ 
struction 
-simple  to  highly 
involved 

-loose  to  highly 
organized 

Speed  of  communi¬ 
cation 

-Production  by 
source  is  natural 
to  the  individual 
-Production  by 
interviewer  is  slow 
natural-to  natural 


Note  taking 

-Driven  by  the 
utterances  of 
the  interviewee 
-English  and/or  Target 
language  are  used 

Prior  preparation 

-sets  of  questions, 
statements  may  be 
prepared . 

-  2  - 
Q_/l 


Expected 
Performance : 


Criteria:  1. 


CRITERIA/STANDARDS 


1.  Establish  Rapport 


Interviewer  will  greet  source, 
make  Introductory  remarks  and 
carry  on  small  talk  while  using 
language  features  and  "body 
language"  appropriate  for  the 
source's  official  position/rank, 
social  status,  level  of  educa¬ 
tion,  sex  and  age. 

Source  will  comprehend  all 
utterances  of  interviewer 
without  need  for  repetition. 


2.  Interviewer  will  use  the  appro¬ 
priate  language  registers  and 
styles  all  times. 

3.  Interviewer  will  not  pause 
longer  than  normal  for  his/her 
natural  speech  habit  while 
addressing  and/or  greeting  the 
source  and  while  making 
introductory  remarks  or  carry¬ 
ing  on  small  talk. 

4.  Interviewer  will  select  the 
appropriate  functions/notions 
in  support  of  the  topics  dis¬ 
cussed,  and  the  language 
exponents  appropriate  for  the 
setting  and  psycho-social  roles 
required  by  the  communicative 
tasks  (functions/notions). 


2.  Conduct  Business 


Expected 
[Performance : 


Criteria:  1. 


Interviewer  will  obtain  all  data 
of  interest  to  US  agencies. 

Source  will  comprehend  all  pre¬ 
prepared  utterances  pertaining 
to  the  identification  of  source, 
explanation  of  the  nature  of 
interview,  questions  on  topics 
etc.,  without  need  for  re¬ 
phrasing  or  repetition. 

Interviewer  will  deliver  all 
pre-prepared  utterances  with¬ 
out  pause. 

Interviewer  will  not  pause 
longer  than  5  seconds  In  a  60 
second  segment  while  delivering 
spontaneous  utterances. 

Source  will  comprehend  9  out  of 
10  unprepared  (spontaneous) 
utterances  without  need  for 
repetition  or  rephrasing. 
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Setting 


7. 


Dimensions  of 
Performance _ 

Use  of  reference 

materials 

-use  Of  dictionary 

and  maps  Is 

permitted. 


5.  Interviewer  will  comprehend 
8  out  of  10  utterances  of 
source  without  need  for 
repetition  or  rephrasing. 
Length  of  utterance  will  not 
exceed  50  syllables. 

6.  Notes  will  contain  all  signif¬ 
icant  data  In  answer  to  the 
standard  questions  such  as 
who  does,  what,  where  and 
when,  etc. 7 


3.  Terminate  Interview 


Expected 

Performance:  Interview*:  will  express  thanks 
and  appreciation,  set  new  time' 
and  place  for  the  continuation 
of  Interview  and  make  closing 
remarks  while  using  language 
features  and  "body  language" 
appropriate  for  the  source's 
official  position/rank,  social 
status,  educational  level,  sex 
and  age. 

Criteria:  1.  Source  will  comprehend  all 
utterances  of  Interviewer 
without  need  for  repetition. 

2.  Interviewer  will  use  the  appro¬ 
priate  language  registers  and 
styles  all  times. 

3.  Interviewer  will  not  pause 
longer  than  normal  for  his/her 
natural  speech  habit  while 
terminating  the  Interview. 


4.  Interviewer  will  select  the 
appropriate  functions/notions 
in  support  of  the  topics 
discussed  and  the  language 
exponents  appropriate  for  the 
setting  and  psycho-social  roles 
required  by  the  communicative 
tasks  (functlons/notlons) . 


TROU  <*>?*  fJ> 


7-3 


CONTENT 


DOMAIN 


NOTES 


General  Topics 


Specific  Topics 


1.  Establishes  Rapport  1. 

-  living  conditions 
in  West  Germany 

-  family 

•  health  and  well 
being 

-  life  in  general 

-  hobbies,  pastimes 

-  etc. 

2.  Conduct  Business 

-  personal  history 

♦  names 

♦  addresses 

♦  exact  dates 

♦  jobs 

♦  functions 

♦  subordination 
+  education  cer¬ 
tificates, 
diplomas,  degree: 

+  training 

♦  research 
activities 

♦  party  membership 

♦  work  setting 

♦  place  of  work 

♦  product 

♦  productivity 

♦  value  of  plant, 
work  place 

♦  interrelationshi{ 
in  his  work  placi 

♦  morale 

-  military  backgrounc 

♦  ranks 

♦  experiences 

♦  training  2. 

♦  supervisors 
+  etc. 


Order  of  Battle 

-  weapons 

♦  parts 

♦  functions 

♦  ammunition 

♦  distribution 

♦  site  (caliber,  etc.) 

-  equipment 

♦  vehicles 

♦  radios 

♦  other  communication 
equipment 

+  engineers'  equipment, 
etc. 

♦  armor 

♦  artillery 

-  location 

♦  barracks 

♦  camps 

♦  sites,  etc. 

-  training  (up  to 
regiment) 

♦  types 

+  methods 

♦  field 

exercises,  etc. 

-  Civil  Defense 

♦  equipment 

♦  training 

♦  morale 

+  discipline 

-  warehouses 

-  ammo  dumps (location, 
site,  etc.) 

-  chemicals  (gases) 

-  biological  agents 

Military  geography 

-  terrain  features 

+  cities,  rivers,  etc. 

-  new  constructions  of 
all  types 

+  size 

+  quality,  etc. 

♦  roads 

♦  railroads, 

+  new  streets  in  cities 

♦  industrial  plants 

-  agriculture  crops 
+  yields,  etc. 

-  power  plants 


1.  The  handbooks  on  each  four  areas  should  be 
consulted  for  further  details  on  topics. 

2.  Proper  phrasing  of  questions  is  vital, 
therefore,  prioT  preparation  is  essential 
for  each  topical  area  to  be  discussed. 

3.  Formulating  unrehearsed  questions  for 
further  probing  is  also  a  requirement.  It 
is  a  more  difficult  task  because  the  inter¬ 
viewer  must  be  able  to  comprehend  the  oral 
input  of  the  source. 

4.  The  language  registers,  styles  used  must 
fit  the  socio-educational  level  of  the 
interviewee.  It  is  a  delicate  matter; 
therefore  special  attention  should  be  given 
to  it  during  prior  preparation,  and  also 

in  training. 

5.  Answers  and  statements  by  the  interviewee 
are  highly  varied  in  style,  dialects  used 
and  levels  of  sophistication.  They, 
therefore,  constitute  a  real  challenge. 

For  this  reason,  aural  comprehension 
should  be  stressed  during  training  in  the 
high  priority  topical  areas. 

6.  Personal  documents  are  often  handwritten. 
Training  in  reading  handwritten  notes  is 
essential. 

7.  Knowledge  of  the  econo-political  systems, 
including  current  list  of  important  office 
holders  of  East  Germany  (the  Soviet  Union, 
etc.)  is  essential.  General  knowledge  of 
recent  history,  geography,  the  educational 
system,  and  other  "area  background"  subject 
matters  are  also  important. 


3.  Socio-political  Topics 

-  organization  of  the 
government 

-  the  Communist  Party 

-  geo-political 
considerations 

-  offices  (mil.,  civ) 

-  office  holders 

-  recent  history 

-  current  events 

-  living  standards 

+  wages  and  prices 
♦  availability  of  goods 
+  money  system 


-  4  -  8-6 


-  scientific  research 

♦  weapon  systems 

♦  equipment 

♦  biological/medical 
research 

♦  psychological 
warfare 

♦  etc. 

-  technological  data 

♦  engineering 

♦  production  data 
o  industry 

o  agriculture 
o  communication 
systems 
etc. 
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COMMUNICATIVE  FUNCTIONS 


COMMUNICATIVE  TASKS 

LANGUAGE  EXPONENTS 

Productive 

Receptive 

1.  Perform  official/social  interaction 

Good  morning,  day,  afternoon, 

See  "Productive" 

-Greet  formally/informally 

evening 

-Introduce  yourself,  others 

Hi,  Hello 

1  am  ♦NP 

See  "Productive" 

-Open  conversation 

My  name  is  +NP 

This  is  +NP 

He/she  is  +NP 

They  are  +NP 

Pleased  to  meet  you. 

Nice  to  meet  you. 

What  is  your  name? 

Who  are  you? 

-  VP+  glad  you  came. 

-VPfglad  you've  accepted  out 

-My  pleasure... 

-I  am  glad  to  be  at 

invitation. 

your  service. 

-Carry  on  small  talk  by 

-How  are  you  today? 

-I  hope  I  can  be  of  help. 
-Thank  you,  I'm  fine. 

inquiring  about' 

-How  is  your  family? 

-Everybody  is  fine. 

(wife,  sons,  daughters, 

-My  +NP  is  sick. 

♦health  and  well  being 

etc. ) 

-How  do  you  feel  today? 

♦-Are  you  healthy? 

Yes,  I  am  healthy. 

♦■Are  you  sick? 

Yes,  I  am  sick 

♦■Living  conditions 

-How  do  you  like  your 

I  don't  feel  well  today. 

apartment? 

-My  apartment  is 

+Is  it  big  enough? 

+big  enough 

♦Is  it  comfortable 

♦not  big  enough  for 

-Do  you  have  problems? 

my  family 

♦with  neighbors 

+It  is  comfortable  but  not 

♦with  the  landlord  etc. 

big  enough 

-Carr  I  help  you  in  any  way? 

-I  have  (no)  problems 

♦•Life  in  general 

-How  do  you  like  it  here? 

with  the+landlord 

♦-the  people 

♦•neighbors 

♦■the  weather 

-Yes,  you  could  do  me  a 

♦•Hobbies,  pastime 

-What  do  you  do  for 

favor: 

1  relaxation? 

♦-please  talk  with  the 

♦■etc. 

♦Do  you  play 

landlord. 

.  tennis 

-I  need  a  new 

.  golf 

♦-stove 

.  soccer 

+refrigerator 

etc. 

♦■carpet 

-Do  you  watch  TV? 

etc. 

♦■What  are  your  favorite 

-please  call  my  neighbor 

programs? 

and  tell  him  that 

♦Do  you  watch  soccer  games? 

♦he  plays  the  music  too 
loud. 

+Do  you  watch  American 
programs? 

-I  like  it  here  very  much 

-Do  you  play  chess? 

♦people  are 

+How  good  are  you  at  it? 

.friendly 

-  6  - 

8-8 

. helpful 

-I  don't  like  it  too 
much. 

+1  have  no  friends. 

♦people  are  indifferent. 
-The  weather  is 
♦nice 
♦too  hot 

i  .  — I 
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Communicative  tasks 


2.  Manage  interview 


COMMUNICATIVE  FUNCTIONS 


LANGUAGE  EXPONENTS 


♦too  cold 

■fit  rain*  a  lot. 

-fthere  la  such  sunahlne 
-I  play 
-ftennls 
♦soccer 
etc. 

-I  s via  a  lot 
-I  watch  TV  very  much 
-I  like  the  sport  progress 
-I  play  chess  every  day 
♦I  play  cheas  well. 


-Identifying  persons 
-fID  card  No. 

♦names 


-►locations 


-►addresses 


►time ,  duration 


-Your  name  is  ♦NP 
-Your  rank  is  +NP 
-Your  official  title 
1S4-NP 

-You  are  -fNP. . .  (Name) 
-You  are  ♦NP. .. (trade , 
profession,  occupation) 

-You  are  from  +  SA 
-You  were  born  +  SA 
-You  lived  in  ♦  SA 
-You  lived  in 
-►street 
♦No  -f  AQ 
-fromfTA  to  +TA 
-during  +TA 
(year,  month...) 

-for  +TA 
(month,  year) 


My  name  is  +NP 
My  ID  No.  is  +  AQ. 

My  rank  is  +  NP 
My  title  is  +  NP 
I'm  +NP 

I'm  +NP  (trade, 
profession,  etc.) 

I'm  from  ♦  SA 
I  was  born  at/in  ♦  SA 
I  lived  at/ln  +  SA 
My  address  was  -f  SA 


from  +TA  to  +TA 
during  +TA 


-Explaining 

♦the  nature  of  interview 


-Suggesting  a  course  of 
action 
-►procedures 


Yes,  I  was  told  about 
that,  too. 


-It  is  an  interview,  not  I  understand 

interrogation 

-You  are  under  no  obligation  Yes,  I  was  told  about 
to  say  anything  that,  too. 

■►you  are  not  obliged  to  +VP 

-you  may  volunteer  Information.  I  would  be  more  than  glad 

to  cooperate. 

-I'll  ask  you  some  standard  Please,  go  ahead.  I  will 
questions  first.  answer  them  if  I  can. 


-I'll  ask  you  some  standard 
questions  first. 


-obtaining  cooperation 


-Reminding 


-Are  you  now  clear  about  the 
nature  of  the  interview? 

-Please  answer  the  questions  to 
the  best  of  your  ability. 

-Next,  I  will  have  some 
detailed  questions  on  topics 
you  are  most  familiar  with. 

-The  information  you  have  on 
some  of  the  topics  may  be 
very  valuable  to  us. 

-We  would  appreciate  very  much 
your  full  cooperation 
-I  wish  (want)  to  remind  you 
that 


Yes,  I  am. 

O.K.  It's  fine  with  me. 

Please,  go  ahead.  I  will 
answer  them  if  I  can. 


I  certainly  hope  so. 

You  are  welcome. 

Naturally,  if  I  am 
uncertain  about  something, 
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COMMUNICATIVE  FUNCTIONS 


COMMUNICATIVE  TASKS 


_ LANGUAGE  EXPONENTS _ _ _ 

Productive  _ Receptive 

I  will  tell  you  so. 

♦answer  questions  only  if  you 
are  sure  of  your  facts. 

-You  should  not  +VP  +NP 
-You  must  not  +VP  +NP 
-Don't  +VP  +NP 


-Requesting  cooperation 


-I  request  your 
♦help 

♦cooperation 

-I  know  you  have  valuable  in¬ 
formation.  Please 
♦help  us 

♦cooperate  with  us 
-Would  you  +VP 
-Could  you  +VP 

-Can  I  have  your  cooperation? 
-Would  you  be  so  kind  to 
♦tell  me 
+lnform  me 


You  got  It. 

I'll  fully  cooperate. 


-More  than  glad  to  +VP 
-Naturally,  NP  +VP 


3.  Seek  factual  Information. 


State  factual  Information. 


-Asking  questions  on  topics 
pertinent  to  source's 
background. 

(see  list  of  topics) 


-Asking  for  clarification 


-asking  for  details 


-Interrogative  sentences 
♦Yes/no  questions. 

♦Sentences  with  question  words 
(who,  when,  what?  etc.) 


♦Declarative  sentences  with 
question  intonation. 

♦Question  tags 

(You  are  not  afraid,  are  you?) 
-What  do  you  mean  by  that? 

-What  did  you  say? 

-Did  you  say  (that)  +VP 
-Could  you,  please,  clarify 
this  point. 

-What  was  the  name  again? 

-What  is  the  name  of  that 
town? 

-Could  you  spell  them  for 

me . 

etc. 


-Could  (would)  you,  please 
extend  on  that? 


-I  mean  what  I  said. 
-What  I  wanted  to  say 
is  +  VP. 

-In  other  words  +NP  +VP 
-Yes,  you  are  correct. 
-Yes,  I  said  that 
-Exactly. 

-I'll  try  to  clarify  it 

-The  name  mentioned  was 
+NP 

-Yes,  I'll  spell  them 
for  you 
A  as  ... 

B  as  ... 

-Certainly. 

-I  would  be  glad  to  +VP 
-Definitely. 
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COMMUNICATIVE  TASKS 


4.  Express/ Inquire  about 
Intellectual  attitudes. 

-agreement 


-disagreement 


-certainty /uncart alnty 
-poaslbl l lty/lmpo*«tbl llty 
-dental/conf Irmst  ton 
-belief/opinion 

5.  Express/ Inquire  about 
emotional  attitudes. 

-pleasure/d lap  lessors 
-Hat  tafact  lon/dlasat  la- 
fact  ton 

-approval/ illaapproval 
-dlff U-ulty/eaae 

NOTE:  The  full  catalogue 
will  contain  all  functlona 
pertinent  to  tlia  Job 


Communicative  nmcriONS _ 

_ LAMCUACK  EXPONENTS 

_ Product  lva _ _ _ 

-Could  w«  go  Into  aora  data  I  la  on 
that? 


-Do  you  hava  Bora  dal al lad  In¬ 
formal  Ion? 

-Who  baa  more  datallad  In- 
fonaatton  on  tbla  topic? 


Receptive 


-Juat  aak  any  quaatlona 
you  want . 

-I  did  not  think  af  that. 
-Now,  aa  yau  aantlanad 
It,  I  racall  ♦VP. 

-An  acqualntanca  (friend) 
of  alna  warkad  In  thla 
f laid. 


-1  agraa 

That 'a  right 

Of  couraa 

Certainly 

1  go  along  +FP 

l  could  not  agraa  store. 

1  share  your  +NP 

Wa  are  In  baalc  agreement 

It  la  so 

I  can  +VP  (Inf.) 

Its  may  +VP  (Inf.) 

-No. 

-1  don't  agree 
-I  don't  think  ao. 

-That 'a  Incorrect. 

-You  are  mistaken. 

-You  are  wrong. 


Saae  aa  "Productive'' 


CCmiNlCATlVE  NOTIONS 


General  Notions 


Language  Exponents 


Content-spec  if  fc" 
Not ions 


language  Exponents 


1.  Temporal  concepts 
-  points  of  time 


-  direct  object 


-  morning 

-  day 

-  afternoon 

-  evening 

-  good  morning 


2.  Present  reference 


-  simple  present  of 
copula 

♦  I  am 

♦  He/she/is  etc. 


V 


}.  Personal  relations 
(social) 


4.  Possessive  relations 


S.  Other  deictic 
elements 


b.  Personal  identifi¬ 
cation 
-  names 

*  first  name 

*  last  name 

*  initials 


-  Terms  of  address  if 
no  proper  name  is 
used. 


-  Letters  of  the 
alphabet 

-  to  call  (to  refer 
to  by  name  of) 

-  to  be  called 

-  rank 

♦  Sergeant 

♦  Officer 

.  Lieutenant 
.  Captain 
etc. 


-  nice  to  ♦  VP 

-  please  to  ♦  VP 

-  personal  pronouns 
I,  we,  etc. 

-  possessive  pronouns 

♦  my  ♦  NP 

♦  your  ♦  NP  etc. 

-  demonstrative  prounouns 

♦  This,  these 

♦  That,  these 

-  interrogative  pronouns 

♦  Who,  when? 
etc. 

-  independent  relative 
pronouns 

♦  What 

-  definite  and  indefinite 
articles 

the,  a(n) 


-  Peter,  Paul,  etc. 

-  Jones,  Smith,  etc. 

N.  R.;  E.  etc. 

This  is  Mr.  Paul  Jones 
This  is  Mrs.  Jones 
This  is  Mr.  Rose  Bird 

Sir,  Miss, 

-  Monsireur 

-  Madame 

-  FrRulein  etc. 

-  Please  spell  your  name 

-  a,  b,  c,  etc. 

-  What  is  the  last  letter? 

-  They  call  him  Peto 

-  Pete 

-  I  am  Capt  Joseph  Rand 

-  Me  is  Sgt  Jim  Butler 
etc. 


-  Mr.  ♦  NP (proper  name) 

-  Mrs .  ♦  NP  (proper  name) 

-  Ms  ♦  NP (proper  name) 
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SOFT  SKILL  SEMINAR  PRESENTATION 


DEFENSE  INFORMATION  SCHOOL  TEAM 

GS-11,  Martha  Gan 
CPT  Gary  Pittman 

Job  Task  Analysis  v.  Task  Analysis 
Presentation  Outline 

1.  DINFOS  Perception  of  a  Soft  Skill. 

2.  Job  Task  Analysis  v  "Task  Analysis" 

3.  Implications  for  Exportable  Instruction. 

4.  Implications  for  Resident  Instruction 

I .  Introduction 

Here  we  presented  our  attention  getter  the  Hardware 

"Critical  Task  Analysis" 


r 


I.  What  do  the  terms  "hard"  and  "soft"  refer  to? 


The  terms  hard  and  soft  are  used  looselv  in  military 
training  and  it  has  been  difficult  for  us  to  come  up  with  an 
operational  definition  based  upon  common  usaqe. 

At  DINFOS  we  focus  on  the  word  SKILLS .  We  talk  about  hard 
and  soft  skills.  Not  MOS,  not  duty  or  job,  not  tasks  but 
skills . 

A  task  can,  and  in  fact  usually  does  consist  of  both  hard 
and  soft  skills. 

In  Draft  TRADOC  Circular  350-3  skill  is  defined  as  -  the 
mastery/proficiency  of  a  technique,  the  ability  to  use 
knowledge  in  the  execution  or  performance  of  a  learned 
action . 

Webster's  defines  skill  in  two  ways: 

A.  The  ability  to  use  one's  knowledge  effectively  and 
readily  in  execution  or  performance. 

B.  Dexterity  or  coordination  especially  in  the  execution  of 
learned  physical  tasks. 

Both  of  these  definitions  are  important  to  analysis. 

The  smallest  result  of  job  task  analysis  is  an  element  or 
step. 


an  element  is  an  action  or  step 

a  skill  is  the  ability  to  perform  an  action. 

When  an  element  is  physical  (involves  muscular  movement)  the 
element  and  the  ability  to  perform  that  action  are  the  same 
for  instructional  purposes. 

When  an  element  is  not  physical  it  is  necessary  to  analyze 
further . 


II.  Job  Task  Analysis  v  "Task  Analysis" 

Quickly  show  slide  reflecting  a  job  task  analysis. 


Job 

Duty 

*  Tasks 

Element/Step 
i _ _ _ _ 

,  Gagne  suggests  that  there  are  3  types  of  task  analysis. 

They  are:  (slide) 


1.  Information  Processing  Analysis 

2.  Task  Classification  Analysis 

3.  Learning  Task  Analysis 


Each  may  be  important  to  analyze  and  use  job  tasks. 

1.  Information  processing  is  a  flowchart  or  listing  out  of 
the  mental  operations  or  steps  required  by  the  learner  to 
perform  the  job  task. 

2.  Task  Classification:  The  application  of  learning  theory 
and  use  of  taxonomies  to  determine  level  of  learning  and 
identify  prerequisite  steps  (heirarchies) . 


cognitive 


Each  of  these  taxonomies  suggests  that  learning  occurs  at 
various  levels,  and  that  in  many  cases  learning  at  one  level 
is  required  to  learn  the  next  level  (heir archies) . 

At  DINFOS  we  have  found  use  of  the  Gagne/Briggs  taxonomy 
most  useful. 


We  have  no  intention  to  address  each  of  the  domains  listed 
above.  Most  of  you  are  familiar  with  them.  We  do  wish  to 
look  at  the  taxonomy  of  learned  capabilities  because  we 
apply  it  to  the  area  of  what  is  referred  to  here  as  "soft 
skills . " 

What  is  a  learned  capability? 

An  outcome  of  instruction. 

Learning  outcomes  in  the  various  domains. 

Let's  look  at  the  taxonomy: 

_ (slide  of  G&B  Taxonomy) 

1.  Verbal  Information 

2.  Intellectual  Skills 

3.  Cognitive  Strategy 

4.  Attitudes 

5.  Motor  Skills 


These  are  the  domains.  This  chart  does  not  reflect  or 
suggest  a  heirarchy. 


* 


(Slide  of  1-3) 

/N  evaluation  3.  Cognitive  Strategy  Originate 

synthesis  2.  Intellectual  Skills 


analysis 

a. 

Problem  Solving 

Generate 

t 

b. 

Use  of  Principles  (Rule) 

Demonstrate 

1  | 

r'  c. 

Defined  Concept 

Classi fy 

application  j 

1  d. 

Concrete  Concept 

Identi fy 

Le* 

Discr imination 

Di  scriminate 

comprehen-  1. 

Verbal  Information 

State 

sion  know- 
ledge 


PSYCHOMOTOR  AFFECTIVE 
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CLASSIFICATION 


Descriptive 

VERB 


4.  ATTITUDE 


chooses 


a.  Characterization  by  value 

b.  Organization 

c.  Valuing 

d.  Responding 

e.  Receiving 
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5.  MOTOR  SKILL 


executes 


a.  Speech  behaviors 

b.  Nonverbal  communication  sets 

c.  Finely  coordinated  movements 

d.  Gross  body  movements 


A  look  at  these  three  domains  does  suggest  a  heirarchy. 

This  chart  says  that  you  must  have  verbal  information  in 
order  to  perform  intellectual  (mental)  skills.  Having  sets 
of  mental  skills  allows  the  learner  to  originate  novel  and 
unique  solutions  to  many  situations.  This  is  a  cognitive 
strategy. 

If  we  can  identify  a  task  as  a  motor  skill  we  can  apply 
analysis  techniques  outlined  in  Chapter  8. 

But  if  a  task  requires  many  mental  operations  to  get  to  the 
observable  performance,  we  have  a  task  that  falls  into  the 
domain  of  intellectual  skills. 

Gagne  suggests  that  intellectual  skills  lend  themselves  to 
learning  task  analysis.  Mickey  will  talk  about  this. 

One  additional  point.  Gagne  uses  a  fixed  set  of  descriptive 
verbs  to  identify  the  learned  outcome  at  each  level  of  each 
domain.  (See  Slide). 

Learning  Task  Analysis. 

Once  a  task  element  has  been  categorized  into  the  various 
types  of  learned  capabilities,  further  analysis  may  or  may 
not  be  required. 

If  the  category  is  psychomotor  an  analysis  of  the  steps 
required  to  perform  a  task  is  sufficient  for  instructional  pur¬ 
poses.  In  this  case  the  learned  outcome  is  the  ability  to 
perform  the  sequence  of  muscular  movements  required  by  the 
action.  This  ability  is  acquired  by  practice. 

For  "mental"  task  or  elements  the  performance  implies  that 
the  required  mental  processes  are  being  performed.  In  other 
words  since  we  can  not  see  these  mental  processes  we  infer 
from  observable  actions  or  products  that  they  are  performed. 
These  mental  processes  are  internal  states  called 
capabilities  . 

To  make  it  easier  to  identify  and  describe  these  internal 
states  or  capabilities  Gagne  and  Briggs  (1974)  suggested 
that  standard  verbs  be  used.  This  was  briefly  discussed  by 
CPT  Pittman. 


For  those  elements  which  fall  into  the  cateqory  of  intellec¬ 
tual  skills  it  is  possible  to  identify  prerequisite  capabi¬ 
lities  required  for  the  individual  to  learn  a  task.  This 
process  is  called  LEARNING  ANALYSIS. 

It  is  generally  accepted  that  previous  learned  capabilities 
support  new  learning.  Ex.  Before  a  child  can  learn  to  read 
he/she  must  be  able  to  recognize  the  different  letters  of 
the  alphabet. 

If  we  are  with  intellectual  skills  the  learning  analysis 
will  estalish  a  hierarchy  (ordered  series)  of  subordinate 
capabilities  which  must  be  learned  before  a  specific  outcome 
can  be  learned. 

Gagne  proposes  that  the  prerequisite  capabilities  are  iden¬ 
tified  by  asking  the  question. 

"What  skill  should  the  learner  already  know  how  to 
do  and  be  able  to  recall,  when  faced  with  the  task  of 
learning  the  new  skill;  the  absence  of  which  would  make 
it  impossible  for  him  to  learn  the  new  skill?" 

Gagne  (1968) 

For  example: 

Task:  Shoot  black  and  white  photographs  with  a  35mm  SLR 

camera. 

One  of  the  elements  might  be 

Set  the  f-stop  ring 

some  of  the  requirements  for  performing  this  element  might 
be: 

1.  Determine  required  f-stop 

2.  Locate  f-stop  ring  on  camera 

3.  Turn  the  f-stop  ring  to  the  f-stop  determined  in 
Step  1. 


The  first  capability  is  an  intellectual  skill.  Determininq 
the  required  f-stop  is  problem-solving,  applying  rules  about 
how  light  interacts  with  film,  the  realtionship  of  depth  of 
field  and  aperature  size  and  other  rules  all  supported  by 
concrete  and  defined  concepts.  These  learned  capabilities 
are  essential  for  adequate  performance  but  they  are  not 
actions  in  and  of  themselves. 


A  learning  analysis  would  identify  a  hierarchy  of  prere¬ 
quisite  capabilities  which  must  be  acquired  bv  the  learner 
before  the  desired  learning  outcome  can  be  achieved. 

To  summarize: 

The  analysis  of  tasks  into  procedural  steps  (job  task 
analysis)  is  not  the  same  as  learning  analysis  which  iden¬ 
tifies  the  prerequisite  capabilities  required  to  learn  a 
task.  Learning  analysis  asks  the  question  "What  must  the 
learner  have  acquired  by  previous  learning,  and  be  able  to 
recall  when  the  new  learninq  is  undertaken?"- 

The  identification  of  prerequisite  learned  capabilities  aids 
us  in  designing  and  evaluating  training  in  several  ways. 

Some  of  those  are: 

1.  It  gives  us  a  guide  for  sequencing  instruction  - 
what  must  be  taught  so  other  things  can  be  learned. 

2.  Helps  to  identify  entry  level  skills  required  before 
undertaking  a  block  of  instruction. 

3.  Allows  us  to  design  instruments  which  evaluate  the 
learners'  entry  level  skills. 

4.  Provides  us  with  a  systematic  approach  for  traininq 
intellectual  skills. 

5.  Allows  us  to  identify  gaps  in  capabilities  which 
may  be  causing  learninq  failure. 

6.  Differentiates  between  essential  knowledges  and 
skills  and  the  "nice  to  knows." 


III.  Implications  for  Exportable  Training 

Task  analysis  at  DINFOS  is  used  to  design  and  evaluate  both 
resident  and  exportable  training  materials.  Because  we  have 
a  small  DTD  the  analysis  and  design  functions  are  usually 
performed  by  the  same  closely  situated  group  of  people. 

This  makes  it  easy  to  transition  between  analysis  and 
design . 

TEC 

It  has  been  a  common  occurance  to  get  a  call  from  our  TEC 
civilian  contractor  asking  us  to  provide  a  SME  for  their 
task  analysis.  It  is  emphasized  that  the  SME  should  be  per¬ 
forming  the  task  so  they  can  observe. 

That’s  all  well  and  good.  But  take  a  task  like: 

Write  a  sports  story  observing  a  SME  performing  this 
task  would  result  in: 

1.  Put  paper  in  type  writter. 

2.  Line  up  paper 


This  would  look  like  a  71L  task  not  a  journalist  task. 

The  important  thing  in  this  case  is  not  a  list  of  observable 
action,  but  the  mental  processes  employed  by  the  SME  in 
determining  what  words,  in  what  order  are  put  on  the  paper. 
Writing  a  news  story  requires  the  use  of  a  cognitive  stra¬ 
tegy.  An  internalized  method  of  pulling  together  all  the 
intellectual,  attitudinal  and  psychomotor  skills  required  to 
produce  an  acceptable  story. 

If  the  TEC  contractor  fails  to  identify  and  teach  these 
required  learned  capabilities  the  novice  learner  will  fail 
to  perform  the  task.  The  learning  outcome  will  not  be 
reached .  " 

EPMS 

The  same  problem  occurs  with  EPMS  products,  particularly 
soldier's  manuals.  The  standard  format  of  performance  steps 
with  action  verbs  does  not  always  fit  the  type  of  task  we 
deal  with  in  public  affairs.  We  are  always  asking  ourselves 
how  we  can  incorporate  much  of  the  "soft"  material  we  feel 
is  necessary  but  does  not  fit  the  format. 
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Remember  that  the  Soldier's  Manual  is  a  training  aid.  If  we 
know  that  there  are  competencies  required  (skills, 
knowledges  and  attitudes)  for  the  learning  of  a  task.  Why 
can't  we  include  those  things  in  the  manual. 

Since  sometimes  specific  actions  do  not  adequately  represent 
the  test  we  should  be  able  to  include  capabilities  in  our 
evaluation  of  a  task.  But  we  can  not  test  anything  which  is 
not  in  the  manual. 

For  many  different  reasons  we  have  managed  to  insert  some  of 
this  "soft"  stuff  through  the  backdoor...  but  why  should  we 
have  to  "sneak"  in  important  task  components.  If  the  format 
does  not  work  the  format  should  be  changed! 

IV  Implications  for  Resident  Instruction 

Use  of  taxonomies,  task  analysis  and  descriptive  verbs  has 
been  very  helpful  in  resident  instruction.  It  helps  to 
bring  the  instructor  back  to  the  job  task  analysis,  and 
helps  to  point  out  systematic  sequencing  and  verbalization 
of  instruction. 

(Slide  Example  of  a  Revised  POI  OBJ) 

Instructors,  in  many  cases,  have  lost  sight  of  the  fact  that 
lesson  plan  objectives  were  based  upon  job  tasks.  Classes 
consist  of  task  elements  and  skills  -  that  relate  to  tasks 
and  duties  -  which  require  the  student  to  organize  and 
transfer  to  written  tests  and  PE's  -  which  further  requires 
the  student  to  transfer  to  the  job. 

General  subject  areas  and  resources  drive  the  sequencing  of 
instruction.  This  falls  to  capitalize  on  learning  theory  - 
use  of  educational  taxonomies  and  instructional  system  design. 
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iurnccucnos  to  sshvice  public  affairs  r:;oc.R«i$  (*jsa  unique) 

Objectives: 

Giv.  i  fjsrtlclptticn  in  a  V.:;ture/ecr,  Terence  end  applicable  Army  Regulations 
«:-.J  T  .0  direct  i\  .s,  the  st'-ic-nt  will  "Ive  A  ray  public  affairs  problems 
escribed  in  sit;  aticnal  *ti-l>ox  exercises.  teaming  is  measured  in  practi¬ 


cal  exercises. 
FD.IC/C2 
References : 


2C/PE2 


i  nir.g 
2C/PE2 


rv-.sured  in  practi- 

2  21 


Dept  of  the  fr  y  Rc.  360-5,  3C0-61,  3G0-81 . 

Dept  of  the  Ar.y  Rem  350-5. 

Dept  of  t;:C-  Ar.  y  Field  Manual  101-5:  •  — • 

Public  Affairs  handbook,  Chapter  11. 

r**  ‘v  • 

PROPOS'D  PEHFOiH-WOE  OBJECTIVE: 

.  V  . 

Given  class  introductions  and  information  concerning  "Anny  Unique"  instruc¬ 
tion,  I.’A  Public  Affairs  organization,  the  defined  concept  of  Public  Affairs 
and  its  functional  areas,  and  a  bibliography  of  Public  Affairs  related  recu- 
Ifttlons;  students  will  be  able  to  discriminate  t.-eng  fellow  students  by 
conducting  functional  interpersonal'  refati on's  hips  using  appropriate  titles 
end  r.anas  during  public  affairs  exorcises;  £^n?r?t<?  solutions  to  service 
unique  situational  problems  by  writing  solutions,  applying  concepts,  regu¬ 
latory  guidance,  and  knowledge  of  DA  public  affairs  structure  during  vVur 
tc':>!.cno  In-fox  exercises  completed  at  intervals  throughout  service  unique 
instructioii;  anticipate  t!:e •?anera t i wi  of  a  special  public  affairs  plan 
rcyjlring  the  writing  of  a  plan  aunmi  a  future  lake-home  exercise;  ar.u 
.r *  t'O-'el/style  for  performing  public  affairs  duties  by  Internal 
i ' • .  Ov  ;iC'.  -to,  principles  and  regulatory  intents  and  responding  with  func- 
tiC  cl  cr.J  appropriate  courses  of  action  to  public  affairs  duties.  Stu- 

ire  provided  with  detailed  criterion  for  In«l’ox  exorcises.  A  minimum 
.Cessing  score  of  7b  is  required  on  all  five  graced  exercises. 


ROTES : 

I  riSCRIHIHATES  *  Domain  of  Intellectual  skills  showing  the  learned 
,_p  \  capability  to  distinguish  .objects, classes,  individuals 


v  \  fro:i  oti«  .  rs/anotltor. 

!*  ~  ^ 

'  \  C  T/JES  "  r  .;iii  of  intnllrctral  skills  si. .wing  thr  learned  capability 

1  ’■  ;  P  _  ’•.i.c  i  .  •  nd  >-u  w! \  •  to  .  •  t«  a  un  i  t.cc 

j uii  (i  ro./Su-it  00 ivn.  j), 
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Goals  of  DINPOS  Traininq  Developments 
(slide) 

1.  Reestablish  the  link  between  resident  instruction  and 
job  tasks  through  the  use  of  job  task/POI  objective  correla¬ 
tion  lists. 

2.  Reestablish  a  relationship  between  how  and  what  we  teach 
with  what  and  how  the  student  will  be  required  to  perform 
(both  for  graduation  from  school  and  success  on  the  job) . 

3.  Reestablish  the  link  between  student  performance  and  job 
performance  by  using  task  classification,  job  performance 
considerations,  performance  objectives  and  criterion 
referenced  testinq. 

4.  Establish  the  instructor  and  developer  as  a  workinq  team 
by  avoiding  the  "too  much  -  too  fast"  approach. 


i  PROBLEMS  WITH  RESIDENT 

INSTRUCTION 


iwetcrs  have  lost  sight  of  the  fact  that 

ION  FLAN  0:i  -CTIVES  WERE  BASED  UPON  JOB  TASKS 

CLASSES* 
consist  of  * 

TASKS,  ELEMENTS'  6  SKILLS 

►  '*  •  , 

the!  relate  to 
TASKS  &  DUTIES 

.  i  * 

fttiich  retire  the  student  to  organize  &  transfer  io 

WRITTEN  TEST  &  P.E.'s 
which  require  the  student  to  transfer  to 


THE  JOB  OF  INFORMATION  OFFICER 
(SPECIALIST) 


GENERAL  SUBJECT  AREAS  &  RESOURCES  DRIVE 

SEQUENCING  CF  INSTRUCTION 


THIS  FAILS  TO  CAPITALIZE  ON  LEARNING  THEORY 

USE  G?  TAXONOMIES  &  INSTRUCTIONAL  SYSTEMS 

DESIGN. 


JOB  ANALYSIS  OF  SOFT  SKILL  BEHAVIORS  FOR  PROFESSIONAL 
MILITARY  EDUCATION  CURRICULUM  DEVELOPMENT 


Jerry  M.  Barucky,  Captain,  USAF 

USAF  Occupational  Measurement  Center 
Randolph  AFB  TX  78148 


A  paper  presented  at  the  Soft  Skills  Analysis  Symposium, 
Department  of  the  Army  Training  Development  Institute, 
Fort  Monroe,  Virginia,  14  August  1979.  This  presentation 
is  based  upon  a  paper  to  be  presented  at  the  21st  Annual 
Military  Testing  Association  Conference,  San  Diego,  CA 


The  views  expressed  in  this  presentation  represent  those 
of  the  author  and  do  not  necessarily  reflect  the  views  of 
the  United  States  Air  Force  or  the  Department  of  Defense. 


JOB  ANALYSIS  OF  SOFT  SKILL  BEHAVIORS 
FOR 

PROFESSIONAL  MILITARY  EDUCATION  CURRICULUM  DEVELOPMENT 

Each  year  in  an  attempt  to  improve  the  professional  military  competence  of 
its  personnel,  the  Air  Force  enrolls  a  significant  percentage  of  its  force 
in  Professional  Military  Education  (PME)  courses.  For  both  enlisted  and 
officer  personnel,  a  series  of  schools  exist  which,  at  various  points  in  a 
normal  career  pattern,  can  be  completed  either  in  residence,  through  home- 
base  seminar  programs  or  via  correspondence  courses.  These  common  schools 
are  designed  to  provide  a  current  picture  of  both  the  military  profession 
and  the  aerospace  role  in  national  defense,  and  to  build  skills  and  knowl¬ 
edge  that  will  help  Air  Force  people  become  better  leaders  and  managers. 

In  an  attempt  to  ensure  that  the  curricula  of  these  programs  are  pertinent 
to  the  needs  of  those  enrolled,  the  USAF  Occupational  Measurement  Center 
(OMC)  was  requested  to  do  a  special  occupational  survey  that  would  identify 
the  leadership,  management,  and  communicative  tasks  performed  by  Air  Force 
personnel  at  each  phase  of  their  career.  It  was  hoped  that  the  data  from 
the  survey  would  assist  curriculum  managers  in  validating  those  portions  of 
their  curricula. 

In  this  effort  we  began  with  the  survey  of  enlisted  personnel  and  used  our 
normal  methodology  to  develop  and  administer  the  survey  instrument.  In 
the  development  process  this  entailed  first,  a  fairly  extensive  research 
of  other  job  analysis  studies  used  for  "professional"  or  executive- level 
education.  Second,  detailed  interview  sessions  with  groups  of  experienced 
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personnel  were  conducted  to  build  a  common  inventory  of  leadership,  manage¬ 
ment,  and  communicative  tasks.  Third,  the  inventory  was  mailed  to  a  fairly 
large  number  of  personnel  (150)  at  operational  bases  worldwide  so  that  they 
could  review  the  statements,  critique  them  for  accuracy  and  clarity,  and 
add  any  tasks  omitted.  Finally,  validation  sessions  were  conducted  with 
PME  school  representatives  to  insure  that  both  the  task  inventory  and  the 
background  or  demographic  questions  would  provide,  useable  data  for  curriculum 
developers.  The  entire  development  process  took  approximately  five  months 
and  resulted  in  a  list  of  264  tasks. 

The  survey  was  administered  to  a  stratified  random  sample  of  11,616  enlisted 
personnel  in  paygrades  E-l  through  E-9.  Especially  heavy  sampling  was  done 
in  paygrades  E-5  and  E-9  to  allow  career-field  specific  comparisons  within 
those  paygrades.  Administration  took  approximately  16  weeks,  and  resulted 
in  a  return  of  9,037  useable  books.  Checks  across  bases,  major  commands, 
and  career  fields  indicated  no  significant  pattern  among  survey  books  not 
returned. 

Initially,  the  data  from  this  survey  effort  have  been  applied  to  curriculum 
validation  in  four  ways  through  a  series  of  workshops  at  which  curriculum 
managers  from  each  phase  of  enlisted  PME  and  all  major  commands  were  present. 
At  these  workshops,  the  general,  leadership,  management,  and  communications 
block  objectives  for  each  phase  of  PME  instruction  were  revised  or  validated, 
based  to  a  great  extent  on  the  percentage  of  the  members  of  a  specific  popu¬ 
lation  group  that  performed  the  tasks  relevant  to  those  specific  blocks  of 
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instruction.  In  the  first  and  simplest  application  then,  curriculum  develop¬ 
ers  were  able  to  determine,  within  various  blocks  of  instruction,  some  of 
the  specific  skills  or  knowledges  to  emphasize.  For  example,  from  the  figures 
in  Table  I,  one  can  see  that,  among  the  examples  of  various  types  of  writing 
skills  or  formats  that  one  might  deal  with  in  teaching  written  communication 
to  E-6s,  it  might  be  more  important  to  insure  that  the  students  can  write  * 

military  letters  or  correspondence  than  to  draft  staff  summary  sheets:  the 
data  shows  that  54  percent  will  perform  the  former  task  in  their  jobs,  « 

while  only  19  percent  are  likely  to  perform  the  latter  task. 

However,  it  may  not  be  as  necessary  to  address  this  task  in  an  E-6  course  if 
one  can  be  assured  that  the  students  are  likely  to  have  developed  the  necessary 
writing  skill  through  earlier  training  programs  or  via  on-the-job  experience. 
This  question  of  prior  knowledge,  however,  illustrates  the  need  to  plan 
carefully  the  sequencing  of  the  curricula  across  the  various  phases  of  PME 
so  that  skills  introduced  at  an  early  level  of  PME  can  be  built  upon  and 
enhanced  at  later  stages,  rather  than  merely  repeated.  Table  2  illustrates 
this  second  application  of  the  survey  data:  how  a  comparison  of  task 
performance  across  paygrades  can  assist  in  planning  the  proper  sequencing. 

Under  normal  circumstances,  one  would  consider  teaching  a  skill  if  at  least 
30  percent  of  the  students  are  likely  to  perform  the  task  employing  that 
skill.  Using  this  rough  guideline,  one  can  see  that  the  skill  necessary  to 
write  military  letters  or  memoranda  should  be  taught  (to  at  least  a  basic 
level)  to  senior  E-4s  or  E-5s.  It  is  also  evident  that  a  large  majority  of 
E-6s  and  E-7s  need  to  apply  this  skill,  and  that,  dependent  on  the  amount  of 


instruction  provided  in  the  earlier  phases  of  PME,  the  PME  schools  attended 
by  E-6s  should  insure  that  their  students  have  developed  this  ability.  On 
the  other  hand.  Table  2  also  indicates  that  other  skills,  such  as  the  ability 
to  design  or  modify  organizational  structure,  need  not  be  addressed  until  an 
NCO  reaches  the  grade  of  E-8.  Tasks  of  this  nature  would  be  more  appropriate 
material  for  a  later  level  of  PME. 

Another  way  in  which  the  survey  data  has  assisted  curriculum  developers 
is  through  the  career-field  specific  comparisons  made  among  E-9  personnel. 
Although  E-8  and  E-9  personnel  are  selected  to  attend  the  final  phase  of 
NCO  PME  irrespective  of  career  area,  a  career  field  task  comparison  indi¬ 
cates  that  their  individual  needs  for  this  material  based  on  task  perform¬ 
ance  may  be  vastly  different.  Identification  of  these  differences  in  task 
performance  can  allow  school  personnel  to  identify  both  the  differences  in 
need  and  the  differences  in  the  experience  of  students  as  they  enter  the 
school.  (For  instance,  NCOS  in  career  areas  such  as  food  service  or  fuel 
management  are  much  more  likely  to  need  skills  in  resource  management  than 
are  NCOs  in  more  technical  fields  such  as  band  or  dental  career  areas.)  With 
this  information,  the  school  personnel  can  develop  elective  blocks,  modular¬ 
ized  or  self-paced  instruction,  or  even  handouts  or  reading  lists  designed  to 
meet  these  differing  needs. 

A  fourth  application  of  the  survey  data  to  the  overall  curriculum  validation 
process  was  the  ability  to  evaluate  the  general  placement  of  the  five  phases 
of  PME  within  the  career  span  of  enlisted  personnel.  Table  3  illustrates 


the  increasing  involvement  with  leadership,  management,  and  communicative 
tasks  experienced  by  NCOs  as  they  rise  in  paygrade.  When  one  compares  the 
differences  in  involvement  at  each  paygrade  with  the  differences  in  the 
amount  of  material  offered  in  each  of  the  phases  of  PME  corresponding  to 
those  grades  (Table  4),  the  present  phasing  seems  to  be  logically  planned. 

The  entire  process  of  validating  curriculum  objectives  according  to  the 
actual  requirements  of  the  job  has  been  readily  accepted  and  supported  by 
the  representatives  at  each  workshop.  Although  the  data  has  validated  a 
majority  of  the  existing  curricula,  numerous  revisions  have  also  been 
suggested.  In  many  cases,  the  representatives'  reaction  has  been  that  the 
revision  recommended  actually  confirmed  their  own  opinions  and  some  of  the 
opinions  expressed  on  student  critiques.  They  stated,  however,  that  it 
often  takes  objective  data  such  as  that  provided  by  the  survey  analysis  to 
convince  people  that  changes  are  needed. 

While  the  enlisted  survey  administration  and  analysis  was  underway,  the 
development  of  a  similar  instrument  for  the  officer  task  list  was  begun. 
Although  the  same  methodology  was  used,  this  development  has  proved  to  be 
much  more  difficult  than  the  development  of  the  enlisted  survey.  There  was 
less  agreement  among  the  officers  interviewed  about  their  involvement  in 
leadership,  management,  and  communicative  tasks,  and  they  were  more  sensi¬ 
tive  to  different  interpretations  of  words  used  in  the  behavioral  state¬ 
ments.  Thus,  after  interviews  with  more  than  100  officers  in  at  least  a 
dozen  detailed  development  sessions,  and  after  a  review  of  the  inventory 


by  more  than  200  officers  in  various  commands  worldwide,  a  listing  of  324 
behaviors  has  been  prepared.  This  survey  instrument  will  be  administered 
to  approximately  12,000  Air  Force  officers  in  paygrades  0-1  through  0-6. 
It  is  hoped  that  the  results  from  this  survey  will  prove  as  useful  as  the 
results  of  the  enlisted  survey  have  been. 
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TABLE  1 


E-6's  PERFORMANCE  OF  SAMPLE  COMMUNICATIVE  SKILLS  TASKS 


PERCENT 

TASKS  MEMBERS 

- - - - - -  PERFORMING 

*  DRAFT  OFFICIAL  LETTERS  OR  MEMORANDA 

54 

*  DRAFT  INPUTS  OR  SUPPLEMENTS  TO  DIRECTIVES  40 

*  DRAFT  MESSAGES  FOR  ELECTRICAL  TRANSMISSION  39 

*  DRAFT  TALKING,  BACKGROUND,  OR  POSITION  PAPERS  19 

*  DRAFT  STAFF  SUMMARY  SHEETS 


TABLE  2 

OF  PERCENT  MEMBERS  PERFORMING  TWO  SAMPLE  TASKS 


COMPARISON  BY  PAYGRADE 

TASK _ 

*  DESIGN  OR  MODIFY  ORGANIZATIONAL 

STRUCTURE 

*  DRAFT  OFFICIAL  LETTERS  OR  MEMORANDA 


E-3 

E-4 

E-5 

E-6 

E-7 

E-8 

E-9 

8 

9 

9 

14 

19 

36 

41 

15 

20 

39 

54 

68 

84 

89 

TABLE  3 


NUMBER  OF  LEADERSHIP, 
30%  AND 

MANAGEMENT,  OR  COMMUNICATIVE  TASKS 
50%  OF  PAYGRADES  E-3  THROUGH  E-9 

PERFORMED  BY 

PAYGRADE 

NO.  PERFORMED 

BY  30%  OR  MORE 

NO.  PERFORMED 
BY  50%  OR  MORE 

E-3 

6 

4 

E-4  (12-48  MOS) 

11 

4 

E-4  (48+  MOS) 

20 

4 

E-5 

69 

14 

E-6 

110 

41 

E-7 

161 

77 

E-8 

210 

121 

E-9 

225 

139 

TABLE  4 

HOURS  OF  INSTRUCTION  AT  VARIOUS  ENLISTED  PME  PHASES 


PHASE 

COURSE 

HOURS 

POPULATION 

I 

NCO  ORIENTATION  COURSE 

@  20 

E-4  (SR.  AMN) 

II 

USAF  SUPERVISOR'S  COURSE 

@  52 

E-4  (SGT) 

III 

NCO  LEADERSHIP  SCHOOL 

@140 

SR.  E-4,  E-5 

IV 

NCO  ACADEMY 

@230 

E-6,  E-7 

V 

SR.  NCO  ACADEMY  ' 

@360 

E-8,  E-9 

8 
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ENLISTED  PME  PHASES 
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DEVELOPMENT  OF  SURVEY  INSTRUMENT 


DISTRIBUTION  OF  FINAL  ENLISTED  SURVEY  SAMPLE 


OF  RESPONSIBILITY  r'j6  T°AIfUN6  TASKS 
AT  LEAST  30*  OF  PA/OPAlt  PERFORMING) 
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MONTHS  MONTHS 

NUMBER  TASKS  PERFORMED  BY  30%  OR  MORE 
NUMBER  TASKS  PERFORMED  BY  50%  OR  MORE 


1  n_?9 


PROGRESSION  OF  MANAGERIAL  TASK  PERFORMANCE 
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SOFT  SKILL  ANALYSIS  PROBLEMS 


Introduction : 

The  purpose  of  this  discussion  period  was  to  identify  the  3 
primary  soft  skill  analysis  problems  within  each  of  three 
service  schools  attending.  This  rank  ordering  of  problems 
was  done  in  small  groups  to  early  on  encourage  discussion 
and  to  achieve  consensus. 

Procedure: 

There  were  10  groups  into  which  the  attendees  were  assigned. 
Each  group  had  45  minutes  to  rank  order  the  3  most  important 
problems.  Each  participant  was  provided  a  list  of  possible 
problem  statements  to  work  from  (Incl  1) .  The  groups  then 
separated  their  findings  in  the  next  session. 

Results: 

The  primary  problem  areas  related  to 

(a)  the  identification  of  soft  skills  and 

(b)  the  analysis  of  soft  skills.  The  actual  results 
of  the  group  discussions  are  shown  in  incl  2. 

These  findings  tracked  exactly  with  the  preliminary  hypothe¬ 
ses  of  the  problems  of  soft  skill  analysis  and  the  focus  of 
the  soft  skill  project.  These  results  were  then  used  as  a 
point  of  debarkation  by  Dr.  Branson  in  his  presentation  of 
the  project  strawman. 


/ 
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SOFT  SKILL/SOFT  TASK  PROBLEM  STATEMENTS/QUESTIONS 

1.  How  do  you  know  a  soft  skill/soft  task  when  you  see  one? 

Is  it  a  task  for  which  there  is  no  known  procedure? 

-  One  that  can  be  done  by  numerous  procedures? 

-  Is  it  one  that  is  driven  by  personality?  Attitude? 

2.  How  do  you  analyze  soft  skills/tasks  when  you  have  one? 

3.  How  do  you  train  soft  skills/tasks? 

4.  How  do  you  state  a  soft  skill/task? 

5.  Do  you  have  a  vocabulary  problem  with  these  "soft"  areas?  Is 
there  a  need  for  a  unique  set  of  words? 

6.  Do  you  feel  there  are  adequate  procedures  (presently  existing)  to 
analyze  these  soft  skills/tasks? 

7.  Do  you  have  trouble  writing  conditions/standards  for  soft  tasks? 

8.  Are  you  having  trouble  making  a  determination  at  what  skill  level 
a  soft  task/skill  should  be  taught?  Problem  on  determining  how  much 
to  include? 

9.  Are  soft  tasks  developed  by  other  proponents  (TRADOC  Service 
Schools)  difficult  to  adapt  to  your  training  program? 

10.  Do  soft  tasks  cost  more  (resources)  to  analyze  than  traditional 
tasks? 

11.  Do  soft  tasks  require  a  new  format  for  task  statements?  Use 
"Action"  statement  in  lieu  of  "task"? 

12.  Do  you  have  confidence  in  the  competency  of  those  designated 
within  your  DTD  to  conduct  soft  skill  task  analysis?  What  prere¬ 
quisites  have  been  identified  for  personnel  selected  for  this  job? 

13.  Are  your  analysts  able  to  detail  sufficiently  a  soft  task,  to 
insure  that  what  is  being  analyzed  is  being  taught? 

14.  Is  there  a  need  for  a  common  form  for  soft  tasks/skill  analysis? 

- ADD  ADDITIONAL  PROBLEM  STATEMENTS - 

15. 


16. 


17. 


18. 

19. 

20. 
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TASK  ELEMENTS 


IDENTIFY  RESOURCES 

EVALUATE  AND  IMPROVE  TASK  DESCRIPTION 

PLAN  THE  TASK  ANALYSIS 

SPECIFY  CUES 

SPECIFY  CONDITIONS 

SPECIFY  OUTCOMES 

SPECIFY  ACCOUNTABILITY 

SPECIFY  STANDARDS 

SPECIFY  PROCEDURES  OR  MODELS 

DOCUMENT  TASK  SPECIFICATION 


REVIEW  AND  REVISE  TASK  SPECIFICATION 


CUES 


TO  INITIATE  PERFORMANCE  OF  THE  TASK  ELEMENT 
CONDITIONS 

OF  TASK  PERFORMANCE/  INCLUDING  RESOURCES, 
PERFORMANCE  AIDS,  WORKSHEETS/  AND  PREREQUISITE 
SKILL  AND  KNOWLEDGE  OF  THE  PERFORMER. 


OUTCOMES 

OF  THE  TASK  ELEMENT 

ACCOUNTABILITY 

FOR  THE  OUTCOMES 


STANDARDS 

FOR  EVALUATION  OF  OUTCOMES 


PROCEDURES 

FOR  TASK  PERFORMANCE 


PERFORMANCE  DESCRIPTION 


A  DESCRIPTION  OF  THE  JOB  PERFORMANCE  WITH  SUFFICIENT 
CLARITY  SO  THAT  THE  ANALYST  WILL  UNDERSTAND  THE  NATURE 
OF  THE  PERFORMANCE.  IT  WOULD  INCLUDE  AT  LEAST  THE 
BEHAVIOR  PORTION  OF  THE  TASK  STATEMENT  AND  MAY  CONTAIN 
MUCH  MORE.  CAREFUL  ATTENTION  SHOULD  BE  PAID  TO  THE 
SELECTION  OF  VERBS  DESCRIBING  OBSERVABLE  PROCESSES  OR 
OUTCOMES. 


1 
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UNITARY  TASK 


A  TASK  WHICH  IS  ALWAYS  PERFORMED  IN  1HE 
SAME  WAY  WITH  THE  SAME  ONSET  CUES. 

« 

' 


REFERENCE  MODEL 


AN  INTERRELATED  SET  OF  PRINCIPLES  OR  KNOW¬ 
LEDGE  FROM  WHICH  A  PERSON  MAY  BE  ABLE  TO 
GENERATE  MANY  DIFFERENT  BUT  RELATED  PROCE¬ 
DURES.  EACH  PROCEDURE,  ALTHOUGH  DIFFERENT, 
MAY  RESULT  IN  EFFECTIVE  PERFORMANCE  BY  DIF¬ 
FERENT  PEOPLE  IN  DIFFERENT  SITUATIONS. 


MULTIPLE  TASK 


A  MULTIPLE  TASK  IS  PERFORMED  FOLLOWING 
BASICALLY  THE  SAME  PROCEDURES  APPLIED  IN 
A  VARIETY  OF  CIRCUMSTANCES.  FAULT  ISOLA¬ 
TION  IS  AN  EXAMPLE  OF  A  MULTIPLE  TASK, 

IN  WHICH  SUBSEQUENT  ACTIONS  ARE  DEPENDENT 
ON  DECISIONS  MADE  EARLIER. 


TRANSFER  TASK 


PERFORMANCE  IN  WHICH  THE  ONSET  CUES  ARE 
LIKELY  TO  BE  VARIABLE,  THE  PROCESSES  USED 
MAY  VARY  FROM  ONE  PERSON  TO  ANOTHER,  OR 
FROM  ONE  SITUATION  TO  ANOTHER,  AND  THE 
OUTCOMES  ARE  LIKELY  TO  BE  EVALUATED  CON¬ 
SIDERABLY  MORE  SUBJECTIVELY. 
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CLASSIFICATION  EXAMPLES 


MAINTAINS  CURRENT  WORK  SCHEDULE 
ACCOMPANIES  ALIEN  TO  HOSPITAL 
DETERMINES  TRAINING  NEEDS 
SITS  ON  SELECTION  PANELS 
ESCORTS  ALIEN  TO  BORDER  STATION 
PREPARES  SUPPLY  REQUISITIONS 
INVESTIGATES  ACCIDENTS 
TAKES  ALIEN  TO  FORIEGN  COUNTRY 
SERVES  AS  LAW  INSTRUCTOR 
DISPOSES  OF  SECURE  MATERIAL 
PERFORMS  PUBLIC  RELATIONS  DUTIES 
MAINTAINS  LIAISON  WITH  INFORMANTS 
DELIVERS  SPEECHES  TO  CITIZEN  GROUPS 
DELIVERS  ALIEN  TO  DEPORTATION  HEARING 
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JOINT  TRADOC/FORSCOM  AGREEMENT  (INCL  7) 


01  01  RR  UU  0320007  JUL  71 

COR  TRABOC  FT  MONROE  VA//ATA6-ASU// 

AIG  7S73 

UNCLAS 

SUB J  OCONUS  TOY  REQUIREMENTS 
A.  TRAOOC  SUPPL  1  TO  AR  1-MO 

OCONUS  TOY  QUARTERLY  REPORTING  REQUIREMENT  IS  SUSPENDED  PND6  PUBLI¬ 
CATION  OF  CHANGE  TO  REF  A.  OCONUS  TOY  REQUESTS  SHOULD  BE  SUBMITTED 
ON  TRADOC  FH  712-R,  TO  THIS  HQ-.  ATTN:  ATA6-ASU  CMRS*  HOWARD! i  10 
SAYS  PRIOR  TO  ANTICIPATES  TVL  BATE •  3^9]  1*3  W 


L.  TONE-*  SCH  QUOTA  ASST-.  ATAG-ASU-.  COORD  NOT  RQR. 
3141 .  3  JUL  71 


ROBERT  W.  WELKER-.  LTC,  AGC > 


ATAG-ASi  310S 
UNCLAS 


032B00Z  JUL  71 
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ATAG-AS-SS  file  cry 


REFERENCES 


OCONUS  TDY 


1.  Primary: 

o  DOD  Directive  5000.7 
o  CINCPAC  Instruction  4650.4 
o  AR  1-40 

o  TRADOC  Suppl  1-40 
o  TRADOC  Memo  1-40 

2.  Other: 

AR  1-40 
PARA 

(1-4,  d/e)  Disclosure  of  Classified  Information: 

( 1  — 4 f )  Logistic  Support  to  Nongovernment: 

( 2— lk )  Requests  for  Contractor  Sponsored  Visits: 

(2-11)  Carrying  Classified  Material: 

(2-2)  Pretravel  Securitv  Briefing: 

(3-1/4)  Military  Airlift  Command  (MAC): 

(3-4)  Passport/visa  Requirement: 

(3-5)  Clothing  Requirements: 

(3-6)  Immunization  Requirements: 


AR  380-10 
AR  360-5 

AR  700-32 

DOD  IS  Req 
5220. 22R 

DOD  Reg 
5200. 1-R 
Ch  8 

AR  381-12 
AR  37-26 
AR  600-290 
AR  670-6 
AR  40-562 


ZT+i'  (  * 
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OCONUS  TDY 


NON -REGULATORY  REQUIREMENTS 

I  PRE-TRIP  PLANNING 

o  Designate  TDY  Team  POC 

o  Purpose  of  Trip  (Is  trip  necessary?) 

.  School  initiates  trip 
.  Field  invites  school 

o  Where  trip*to?  (Trip  Plans/Duration) 

.  MOSs  type/location/density  (TAADS/MILPERCEN) 
.  Equipment  location 
.  Review  prior  audit  trail 
.  TDY  $  status 
.  Other? 

-  TRADE-OFFS  REQUIRED?  - 

o  Team  Composition 

.  Knowledge  of  Job  and  Task  Analysis 
.  Prior  TDY  experience 
.  Compatibility  (long  trips) 

.  Speak  foreign  language 
.  Other? 

o  Command  Group  Permission 

.  Required  if  not  tasked  by  Commandant 
.  Command  group  member  traveling/plans 

o  POC  (Identify/Coordinate) 

.  Establish  POC(s)  at  TDY  site. 

.  FONECON  Coordination: 

.  Trip  purpose  (clearly  detailed) 

.  Tentative  dates 

.  Team  composition  (name/rank/grade) 

.  Proposed  itinerary  (clearly  detailed) 

.  Minimum  support  requirements 
.  Quarters  (government/non-government) 

.  Local  vehicle 
.  Security  clearnance 

.  Command  support  requirements  (minimized) 

.  Identify  TDY  team  POC/AV  #/etc. 

.  Other? 


Jrftl  S 
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.  POC  Interface  Emphasis 


.  1  OCONUS  POC  sufficient  (for  only  1  unit  visit) 

.  1  OCONUS  POC  (for  large  area  visit  (USAREUR,  etc) 

.  POC(s)  must:  Coordinate  itiner ary/unit  commitment- 
.  Travelers  must:  maintain  close  FONECON  with  POC 
(before/dur ing  TDY :  to  verify  plans) 

-  POC  =  SUCCESS/FAILURE  OF  TDY  - 

(F)  o  Formal  Coordination 

.  Commandant  letter  to  OCONUS  CG 

.  Reference  informal  coordination  details 
.  Provide  tentative  itinerary  for  comment/change 

.  OCONUS  CG  reply  to  commandant 

.  Trip/details  confirmed/amended 
.  Itinerary  confirmed/amended 

(F)  o  Intra-School  Coordination 

.  Advise  school  activities  of  TDY  (DEV,  etc) 

.  Solicit  input/other  needs 

o  Data  Requirements 

.  Critical  task  list(s)  ready 
.  All  data  needs  identified 
.  All  data  collection  instruments  developed 
.  Questionnaires 
.  Surveys 
.  Titerviews 

.  Determine  printing  requirements  earlyl 
.  Other? 


o  TDY  Orders/Tickets  (during  informal  coordination) 


(F) 


Begin  travel  arrangements  early 

.  Military  Air  Command  (AR  37-26) 

.  Commerical  airline 

.  Rental  car  (Note:  major  USA  companies  have 

OCONUS  affiliates) 

.  Port  call  requests 

Type  of  Orders:  Provide  for  contingencies/minimal 
unit  impact  allow  for  rental  car/non-gvt  quarters/ 
itinerary  changes)  DD  Form  1610) 

Await  theatre/area/countrv  clearance  (AR/TRADOC 
Suppl  1-40) 

Upon  clearance:  authenticate  travel  orders. 


NOTE :  (F)  =  Formal  procedures  required. 


13-11 


o  Individual  $ 


.  Obtain  (as  necessary)  advanced  TDY  $ 

.  Include  rental  car/gas  expenses 
.  Other? 

o  Other  Personal  Considerations 

.  International  drivers  license:  2  passport  photos/USA 
Lic/3.00 

.  Insurance  requirements  (auto/other) 

.  Gas  rationing  problems 
.  Immunizations/shot  card  (AR  40-562) 

.  Passport/visa  (AR  600-290) 

.  Special  clothing  (AR  670-6) 

.  Other:  shoes/shorts/glasses  (etc). 

II  AT  TEMPORARY  DUTY  STATION 

o  Re-coordination  with  POC(s) 

.  Date/time/place  of  visits 

.  Alert  unit  POC(s)  of  arrival/local  phone  # 

.  Other? 

o  Establish  trip  book/audit  trail 
.  Detailed  itinerary 

.  Inserts  of  material  provided  POC(s) 

.  Inserts  of  material  received  from  POC(s) 

.  Detailed  diary  of  events/perceptions  (etc) 

o  Special  Arrangements 

.  Large/small  conference  rooms 
.  Meeting  with  commanders/staff  officers 
.  To  obtain  information 

.  To  provide  information  (exit  feedback) 

.  Exit  briefing  (minimized) 

III  POST-TRIP  ACTION 

(F)  o  Trip  Report 

.  Key  personnel  contacted 
.  Tr ipbook/audit  trail  events 
.  Exit  briefing  notes 
o  Data  analysis/appropriate  action. 

(F)  o  Letter  of  Appreciation 
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JOINT  TAAT  -  FT.  HOOD 
AFTER-ACTION  REPORT 


RECOMMENDATION 

CHANGE  TAAT  TO  RELATE  BETTER  TO  TRADOC  NEEDS 


UNCI.  ASS  IF  IC  D 


01  0?  RR  RK  UU  •  0313UQZ  Aur,  7., 

CDR  TRADOC  FT  MONROE  VA  //ATSC// 

A J C  ATI 
AIG  fllB 

CDR  APVlIN  CENK  n  BEN  HARRISON  IN 
C DR  USACACE  FT  LEAVENUORTH  KS 
CDR  USALOGC  FT  LEE  VA 
CDR  US  AC  DE  C  FT  ORD  CA 

CDR  TRADOC  CONG  ARMS  TEST  ACTV  FT  HOOD  TX 

1 

DIR  TRADOC  SYS  ANAL  ACTT  1‘SMRNM 

INFO:  CDR  FORSCOM  FT  MCPHERSON  GA//AFOP-TAT/AFLG-CL/AFOP-COR// 

UNCLAS 

SUBJECT:  VISITS  TO  rORSCOM  ACTIVE  COMPONENT  INSTALLATIONS/UNITS 

A-  FORSCOM  MSG  CArOP-TATI  DTD  BL.1630Z  JUL  70,  SUBJECT:  CONSOLIDATED 

visits  to  forscom  units/installations- 

B-  FORSCOM  LTR  CAFCGI  DTD  E3  MAR  70,  SUBJECT:  LOGISTICS  ASSESSMENT/ 
ASSISTANCE  TEAM  CL AAT> . 

C.  TRADOC  LTR  CATTNG-UTDI  DTD  IB  JIJN  71,  SUBJECT:  FORT  HOOD  TRAINING 
ASSISTANCE/ASSESSMENT  TEAM  CT A ATI  VISIT  AFTER  ACTION  REPORT- 
PART  I-  VISIT  PROGRAM 


D  C  S  P  C  K  ,  P  C  SO  R I  ■>  D  C  S  C  l' ,  DCSDOC  ,  DCSRU,  DCST,  PCSROTC,  DCSLOG,  AG,  ENGR  , 
DTMAS,  CM  PA,  CH  CP-E,  PM,  IG,  SDO,  CONCISE,  ARNG/USAR  ADVISORS,  CDR 
FLD  ELEM,  CDR  ATSC,  TRADOC  LNO,  ATCM,  ATCS  CBI 


RAY  C-  CLARE,  CPT,  GS 
ATTNG-UT,  ‘1171,,  3  AUG  71 

liOL'Af.l'  G-  CROUCH.,  DG , 


GS,  ‘1.71,3 


7 


UNCI  ASSII  TED 
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OP  07 


RR  RR 


IIU 


AUG  7‘i 


TUTS  ML SN ACL  ANNOUNCES  TIIL'  KFSIJI  TS  0T  A  JOINT  TRA DOC/FORSC ON 
AGREEMENT  TO  MANAGE  VISITS  TO  FORSCOM  INSTALLATIONS/UNITS. 

.  ?•  BOTH  HO  fORSCOn  A ND  HO  TRADOC  AGREE  THAT  TRADOC  REQUIREMENTS  FOR 
.  VALIDATION-,  SURVEY-,  ETC  CANNOT  ALl.  PE  ENCOMPASSED  IN  A  CONSOLIDATED 
VISIT  PROGRAM.  THIS  PROGRAM-,  FROM  A  FORSCOM  PERSPECTIVE  ,  HELPS  ALE- 
VI ATE  THE  PROBLEM  OF  A  CONTINUOUS  STREAM  OF  VISITORS  UHO  DISRUPT 

* 

TRAINING  ACTIVITIES.  TRADOC  ACTIVITIES  BENEFIT  FROM  A  SIMPLER, 

QUICKER  VISIT  COORDINATION  PROCCSS  AND  IMPROVED  ACCESS  TO  HOST  UNIT 

PERSONNEL.  SINCE  THE  PURPOSE  OF  THE  PROGRAM  IS  TO  REDUCE  THE  INTER- 

•  • 

RUPTIOfJS  TO  TRAINING  AND  TO  MAfcE  TRADOC  VISITS  MORE  PRODUCTIVE  VISITS, 
THOSE  TRADOC  VISITS  WHICH  DO  NOT  DISTRACT  FROM  TRAINING  ARE  NOT  IN¬ 
CLUDED  IN  THIS  PROGRAM.  THE  OPERATIONS  DIRECTORATE,  ODCST,  HO  TRADOC 
CATTNG-OPNI  IS  TRADOC  PROPONENT  FOR  THE  VISIT  PROGRAM. 

3-  THE  VISIT  PROGRAM  CONSISTS  OF  FOUR  PARTS  AS  FOLLOWS : 

A-  TRAINING  ASSISTANCE /ASSESSMENT  TEAM  CTAAT)  :  THE  TAAT  IS  A 
FORSCOM  PROGRAM  WITH  THE  PURPOSE  OF  ASSISTING  AND  ASSESSING  UNIT/ 
INSTALLATION  TRAINING-  THE  ACTIVE  COMPONENT  TRAINING  DIVISION, 

ODCSOPS ,  HO  FORSCOM  COORDINATES  TAAT  VISITS,  WHICH  MAY  INCLUDE  TRADOC 
AS  UELL  AS  FORSCOM  VISITORS-  TAAT  VISITS  ARE  UNANNOUNCED.  THESE 


J- 
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1  -■  ■  —  ■  . ‘  . 

l)N CL  ASM  I  1L  D 


03  07  RR  RR  UU 

VISITS  no  ROT  SURVEY-,  VALIDATE  OR  IN  ANY  WAY  KE UU1RE  TRAINING  TO  BE 
DISRUPTED-  * 

0.  LOGISTICAL  ASSESSMENT /ASSISTANCE  TEAM  Cl  A  AT)  :  A  FORSCOM  TEAM 
AUGMENTED  WITH  PERSONNEL  FROM  DA,  DARCOM,  AND  TRAPOC  WHICH  LOOKS  AT 
ALL  ASPfCTS  OF  MAINTCNANCF  AND  SUPPLY  PROGRAMS-  THE  OBJECTIVE  IS  TO 
IDENTITY  AND  DEFINE  RESPONSIBILITY  FOR  CORRECTION  Of  ANY  DEFICIENCIES 
WHICH  MAY  BE  FOUND  IN  THE  TOTAL  LOGISTICS  SYSTEM.  THE  L  A  A  T  PROGRAM 
IS  NOT  DESIGNED  FOR  CONDUCT  OF  SURVEYS,  VALIDATIONS,  ETC-  THE  L  A  AT 
OFFICC  CODCSLOG,  Hr?  FORSCOM)  COORDINATES  L  A  AT  VISITS.  THE-  L  0G1STIC  S 
CENTER  EATCL-TGI  IS  PROPONENT  FOR  THE  TRADOC  PARTICIPATION  IN  LAAT 
AND  (JILL  COORDINATE  TR„DOC  PARTICIPATION  WITH  THE  LAAT  OFFICE  PRIOR 
TO  EACH  VISIT.  THE  LOGISTICS  CENTER  IS  TO  PROVIDE  RESULTS  OF  LAAT 
VISITS  TO  COMBAT  SERVICE  SUPPORT  SCHOOLS- 

C.  CONSOLIDATED  TRADOC  VISIT  CCTVJ:  THIS  PROGRAM  IS  BASED  ON 
THE  NEED  OF  TRADOC  ACTIVITIES  TO  CONDUCT  VALIDATIONS,  SURVEYS,  ETC- 
THE  CTV  CONSISTS  PRIMARILY  OT  VISITS  WHICH  DO  DISRUPT  UNIT  TRAINING- 
COORDINATION  OF  CTV  VISITS  IS  ACCOMPLISHED  DIRECTLY  BETWEEN  THE 
VISITING  TRADOC  SCHOOL/ ACTIVITY  AND  THE  FORSCOM  HOST  INSTALLATION/ 
UNIT  IN  ACCORDANCE  WITH  THE  PROCEDURES  OUTLINED  IN  PARAGRAPH  5  BELOW- 
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ORDINATION  WITH  HOST  INSTALLATION/UNIT  UHL'N  REQUIRED,  BUT  TRADOC  AC¬ 


TIVITIES  SHOULD  WITHHOLD  SUCH  CONTACT  UNTIL  NECCSSARY  TOR  VISIT  CO¬ 
ORDINATION.  VISIT  REOUIREtlCNTS  ARC  FINALIZED  BY  OESSAGE  UITH  HOST 
ORGANIZATION  CINFOR:  HQ  FORSCOH,  AFOP-COR)  FOURTEEN  DAYS  PRIOR  TO 
VISIT. 

L.  THE  CONSOLIDATED  TRADOC  VISIT  SCHEDULE  THROUGH  HAY  1*160  IS  AS 


FOLLOWS: 

INSTALLATION/UNIT 

27-31 

AUG 

70 

XVIII  ABN  CORPS 

10-1M 

SEP 

70 

107TH  INF  BDE/3BTH 

5M-P6 

SEP 

70 

3D  ACR/11  ADA 

S-T 

NOV 

70 

101ST  ABN  DIV 

Db-30 

NOV 

70 

7TH  TRANS  GP 

1J-14 

DEC 

71 

24TH  INF  DIV 

7-11 

JAN 

60 

OTH  INF  DIV 

14-16 

JAN 

60 

7th  INF  DIV 

4-6 

FEB 

60 

STH  INF  DIV 

25-20 

FEB 

60 

103D  INF  BDE 

10-14 

MAR 

60 

III  CORPS  ARTY 

UNCLASSIFIED 


04  o?  RR  RR  uu 


AUG  ?n 


II 


P.  PARTNERSHIP  PROGRAM  -  SINCC  ALL  TRADOC  VISIT  REQUIREMENTS  DILL 

NOT  FIT  INTO  THE  CT  V  HQ  FORSCOfl  HAS  PROPOSED  A  "PARTNERSHIP"  BETWEEN 

SPECIFIC  TRAPOC  ACTIVITIES  AND  SPECIFIC  FORSCOM  INSTALLATIONS/UNITS. 

TRAPOC  ACTIVITIES  ARE  ENCOURAGCP  TO  ESTABLISH  AND  MAINTAIN  POC  WITH 

Clcjiaur.  ft  L.  v-  '•«  • 

THEIR  "PARTNER"  INSTALLATION/UNITS.  THE  PROGRAM  RCflUT-BfrS  W  GL-O-SE 

( 

A'ffD— €X>W-I NttOtl S  COORDINATION  BETWEEN  PARTNERS.  u>,w- 

M  •  OTHER  VISITS:  A  "CLEARING  HOUSE"  ESTABLISHED  AT  H<3  FORSCOM  CO¬ 
ORDINATES  ANY  VISITS  WHICH  DO  NOT  FIT  THE  VISIT  PROGRAM.  THIS  IN¬ 
CLUDES  VISITS  WHICH  SHOULD  BE  SEPARATELY  COORDINATED  BECAUSE  OF  ’UN¬ 
USUAL  LENGTH  OR  COMPLEXITY-.  SUCH  AS  VISITS  TO  MORE  THAN  ONE  INSTALLA¬ 
TION  AND  TEC  VALIDATIONS.  CURRENT  OPERATIONS  DIVISION-,  ODCSOFS-,  Ht? 

(  fll  to A !  K.  f  ff*  -  i/of/ •////) 

FORSCOM^COORDINATES  THESE  VISITS.  JUSTIFICATION  FOR  NON-PARTICIPA¬ 
TION  IN  -ONE-^F  THE  ABOVE  VISIT  PROGRAM^ IS  REQUIRED-  <'■*><?  U> 

'» . '  ,  •  *  •  *9  : .-» 'v‘  '  JSM'AfT  W.*>  • 


PART  II:  PLAN  FOR  COORDINATION  OF  CTV  VISITS- 

(OffD,  nc*;r)  -  t<C(  ,1  OirUTir*/  w/ry  OS" 5t»r.  *»/ F'i  •'< 

S.  HP  TRAPOC,,  ANNOUNCES  ONE  YEAR  IN  ADVANCE  THE  DATES  WHEN  FORSCOM 

INSTALl ATIONS  AND  UNITS  ARE  SCHEDULED  FOR  MAXIMUM  FEASIBLE  VISITS  BY 

TRADOC  ACTIVITIES  -CCTV  PROGRAM!-  THIS  SCHEDULE  IS  THE  SAME  AS  THE 

L  A  AT  ■>  THEREBY  HAVING  TWO  TRAINING  DISTRACTING  PROGRAMS  DURING  THE 


SAME  Pr.'TOD.  TRADOC  ACTIVITIES  INITIATE  OPEN  DIRECT  TELEPHONIC  CO- 


•jl  n? 


RR  KR 


UU 


AUG  V‘l- 


17-Bfl  MAR  CD  III  CORPS 

?6  APR  -  U  MAY  AO  17BD  INI  UDC 

PART  III:  PLAN  TOR  COORDINATION  OT  PARTNERSHIP  VISITS. 

I 

?•  THE  FOLLOWING  PAIRING  OE  FORSCON  INSTALLATIONS/UNITS  UITH  TRADOC 
ACTIVITIES  IS  A  PROPOSAL:  IT  CAN  BE  MODIFIED-  THE  FORSCOn  PARTNER'S 
ABILITY  TO  PROVIDE  A  SUITABLE  TARGET  POPULATION  IS  BASIC  TO  THE  PRO- 
GRAD.  TRADOC  ACTIVITIES  DAY  BE  PARTNERS  UITH  MORE  THAN  ONE  FORSCOfl 
INSTALLATION/UNIT: 


FORT  BRAGG 

INFANTRY  SCHOOL 

ENGINEER  SCHOOL 

ORDNANCE  AND  CHEMICAL  SCHOOL 

SIGNAL  SCHOOL 

TRANSPORTATION  SCHOOL 

FORT  ORD 

INTELLIGENCE  SCHOOL 

ORGANIZATION  EFFECTIVENESS 
I  RAINING  CTR  f.  SCH 

r  tty '  > 

t  ,  ■  .frfciiMCe  -j 
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FORT  HOOD 
LOGISTICS  CENTER 
ARMOR  SCHOOL 
FIELD  ARTILLERY  SCHOOL 
MILITARY  POLICE  SCHOOL 

FORT  RILEY 

INSTITUTE  FOR  MIL'l****  ADMINI¬ 
STRATION 

ADMINISTRATION  CENTER 


i 


UNCLASSIFIED 


' 


Q7  07  RR  RR  Ull 

TRANSPORTATION  SCHOOL 
INFANTRY  SCHOOL 
.  FORT  POLK 

INFANTRY  SCHOOL 
•  FORT  CARSON 
ARMOR  SCHOOL 
CUARTERMASTEK  SCHOOL 
6-  REflUCST  FOR  PARTNERSHIP  CHANGES/ADDITIONS  SHOULD  BE  FORWARDED  TO 
H Q  TR ADOC  -i  ATTN:  ATTNG-OPN  •  IMPLEMENTATION  OF  THE  PARTNERSHIP  -PRO- 
GRAM  IS  PLANNED  FOR  1  OCT  71- 


AUG  7H 

f7" 

A  u>h  Ivor' 

FORT  STEWART 
INFANTRY  SCHOOL 
I.1TH  ADA  GROUP-.  FT  BLISS 
MISSILE  AND  MUNITION  SCHOOL 


FT  HOOD  TAAT  (30  APRIL  -  A  MAY  1979) 
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SUBJECT:  VALIDATE  TASK  LISTS 
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2d  Armored  Division  2  May  0800-1700  10051 

1st  Cavalry  Division  2  May  0800-1700  TBD 

7.  Coordinating  Instructions:  Escort  required  from  2d  Armored  division  on 
1  and  2  May.  Escort  from  1st  Cavalry  Division  required  on  3  May. 


IDENTIFYING,  MEASURING,  AND  TRAINING  "SOFT  SKILL"  COMPETENCIES 
WHICH  PREDICT  PERFORMANCE  IN 
PROFESSIONAL,  MANAGERIAL,  AND  HUMAN  SERVICE  JOBS 


Lyle  M.  Spencer,  Ph.D 
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A  paper  presented  at  the  Soft  Skill  Analysis  Symposium, 
Department  of  the  Army  Training  Development  Institute, 
Fort  Monro.e ,  Virginia,  15  August  1979. 


Lyle  M.  Spencer,  Jr.,  Ph.D.  is  Vice  President  of  McBer  and  Company, 
a  management  consulting  and  training  firm.  Copies  of  this  article 

MAn02116SqU<(617?  26°m5570er  ***  C°mpany'  137  NawburV  Street,  Boston, 


Introduction 


This  paper  will  describe  a  new  personnel  procedure.  Job 
Competence  Assessment  (JCA) ,  which  has  been  successfully  used 
to  identify  "soft  skill"  competencies  which  predict  performance 
in  professional,  managerial,  and  human  service  jobs. 

I  can  best  introduce  the  Job  Competence  Assessment  method 
by  providing  an  example  from  one  of  the  seminal  projects  in 
which  it  was  used. 

In  the  early  1970s,  McBer  and  Company  was  approached  by  the 
United  States  State  Department  for  assistance  in  selecting  and 
assessing  the  performance  of  Junior  Foreign  Service  Officers  (FSOs) . 
Traditionally,  the  State  Department  had  selected  Foreign  Service 
Officers  through  the  use  of  a  Foreign  Service  Officer  exam.  This  * 
exam  was  based  on  the  hypothesis  of  senior  statesmen  officials 
that  the  skills  required  for  effective  performance  as  a  modern 
diplomat  were  essentially  "liberal  arts"  knowledge  and  culture: 
American  history,  Western  civilization,  verbal  fluency,  and  such 
specialities  as  economics  and  government.  Typical  items  on  this 
exam  presented  an  aspiring  FSO  with  a  line  of  Greek  poetry, 
followed  by  a  multiple  choice  question  as  to  the  line's  author: 
Aeschylus,  Sophocles,  Euripides,  Aristophanes. 

This  exam  had  two  principal  drawbacks.  First,  it  was  quite 
discriminatory:  Minorities  and  others  from  less  privileged, 

"cultured"  backgrounds  were  much  less  likely  to  pass  it.  Second, 
and  more  importantly,  performance  on  this  test  not  only  did  not 
predict  performance  as  a  Foreign  Service  Officer,  but  scores 
were  actually  negatively  correlated  with  ratings  of  on-the-job  per¬ 
formance  (McClelland  &  Dailey,  1973). 

McBer  was  asked  to  develop  a  methodology  to  answer  the  obvious 
question:  If  verbal  fluency  and  cultural  content  knowledge  do  not 

predict  FSO  performance,  what  skills  and  competencies  do?  The 
Job  Competence  Assessment  methodology  used  to  answer  this  question 
consisted  of  the  following  steps. 

First,  the  State  Department  was  asked  to  identify,  through  a 
variety  of  techniques  (including  supervisory,  peer,  and  client 
nominations  and  ratings)  one  criterion  sample  of  its  best  Junior 
FSOs  and  another  of  average  FSOs. 

Second,  superior  and  average  performers  were  interviewed  using 
an  in-depth  "Behavioral  Event  Interview"  (BEI)  technique.  This 
method,  developed  by  Harvard  University  psychology  Professor  David 
C.  McClelland  and  colleagues  at  McBer  and  Company  (McClelland,  1970) 
is  derived  from  Flanagan's  (1954)  classic  Critical  Incident  Method. 


15-2 


competency,  first  in  a  supportive  training  environment,  and  then  in 

i  1  1  {  f  A  Dnrpnnc  f  va  i  noH  -in  nr>  h  i  ouomoTl  f-  mof  i  wa- 


It  asks  interviewees  to  identify  the  most  critical  situations 
they  have  encountered  on  their  jobs  and  describe  these  situations 
in  considerable  narrative  detail:  What  led  up  to  the  situation? 

Who  was  involved?  What  did  the  interviewee  think  about,  feel, 
and  want  to  accomplish  in  dealing  with  the  situation?  What  did 
he  or  she  actually  do?  What  was  the  outcome  of  the  incident? 
McClelland's  method  goes  beyond  Flanagan's,  however,  in  that  it 
includes  thematic  apperception  test  probes  which  elicit  data 
about  the  interviewee's  personality  and  cognitive  style  (e.g., 
achievement  motivation  or  convergent  thinking  ability) . 

Third,  interview  protocols  were  content  analyzed  to  identify 
characteristics  and  behaviors  which  distinguished  superior  from 
average  job  incumbents. 

Fourth,  hypotheses  about  competencies  which  discriminated 
superior  from  average  performers  were  tested  in  two  types  of 
cross-validation  designs.  Additional  interviews  were  conducted 
with  a  second  set  of  superior  and  average  job  incumbents.  These 
interviews  were  empirically  coded  for  elements  which  distinguished 
the  two  groups  in  the  first  criterion  sample.  (Empirical  coding 
of  interviews  can  be  done  with  high  interrelater  reliability, 
rs  =  .80  -  .90,  providing  quantitative  data  that  can  be  used  in 
standard  statistical  tests  of  significance.)  Objective  tests 
were  then  developed  to  measure  the  presence  of  competencies 
causally  related  to  the  behaviors  reported  in  the  behavioral  event 
interviews.  Discriminate  function  analysis  techniques  were  used 
to  see  how  well  interview  and  test  variables  derived  from  the  com¬ 
petency  model,  based  on  the  first  criterion  sample,  predicted 
classification  of  superior  versus  average  performance  in  the  second 
validation  sample. 

The  findings  of  the  State  Department  study  were  very  interesting. 
The  types  of  competencies  which  discriminated  superior  from  average 
Foreign  Service  Officers  were  such  soft  skills  as: 

•  nonverbal  empathy:  the  ability  to  "hear"  what  a  person 
from  a  foreign  culture  was  really  saying  or  meaning  in 
a  negotiation; 

•  a  skill  we  wound  up  calling  "speed  in  learning  political 
networks , "  the  ability  to  very  quickly  figure  out  in  a 
foreign  capital  that  it  was  the  Prime  Minister's  executive 
assistant's  mistress'  nephew  that  really  called  the  shots 
in  a  particular  area  of  foreign  policy — and  how  to  get  to 
this  nephew;  and 

•  positive  expectations,  or  what  Rosenthal  (1976)  calls  "the 
Pygmalion  effect”:  a  strong  belief  in  the  underlying  dignity 
and  worth  of  others  different  from  oneself,  and  the  ability 
to  maintain  this  positive  outlook  under  stress. 


These  and  other  nontraditional  "soft  skill"  competencies  did 
demonstrate  criterion  validity  in  predicting  Foreign  Service  Officer 
performance  at  statistical  levels  of  significance  and  proved  not 
to  be  discriminatory  on  racial,  sexual,  or  SES  background  bases. 

This  Job  Competence  Assessment  process  has  now  been  used  to 
identify  the  "soft  skills"  which  predict  performance  in  more  than 
50  professions,  from  manufacturing  managers  and  computer  design 
engineers  in  high  technology  industries,  to  paraprofessional  human 
service  workers  in  New  York  City,  to  Unitfed  States  naval  officers. 


The  Job  Competence  Assessment  Process 

The  Job  Competence  Assessment  process  has  since  been  elaborated 
to  include  some  of  the  job  task/function  analysis  techniques  per- 
scribed  in  the  DOD's  FSO  model,  and  the  job  element  analysis  methods 
developed  by  civil  service  researchers  (Primoff ,  1977) .  The  present 
process  remains,  however,  based  on  the  assumption  that  the  best  way 
to  identify  the  knowledge,  skills,  or  other  abilities  needed  to  per¬ 
form  competently  in  a  job  is  (1)  to  identify  the  most  effective 
performers  in  that  job;  (2)  study  what  these  people  actually  do  that 
distinguishes  them  from  individuals  whose  performance  is  less  satis¬ 
factory;  and  (3)  identify  the  specific  skills,  abilities,  or 
characteristics  which  are  responsible  for  this  difference. 

The  current  Job  Competence  Assessment  process,  now  being  used 
to  identify  competencies  of  effective  Army  Organizational  Effective¬ 
ness  Staff  Officers,  consists  of  eight  steps  (see  Figure  1) . 


(1)  Define  Performance  Effectiveness  Criteria 


To  identify  superior  job  incumbents,  it  is  first  necessary  to 
define  measures  of  performance  effectiveness  in  a  given  job.  Ideal 
criteria  are  "hard"  outcome  measures,  such  as  sales  or  profits  data 
in  industry,  or  unit  performance  outcomes,  such  as  ARTEP  scores  or 
retention  rates,  for  military  officers.  In  the  absence  of  such  cri¬ 
teria,  supervisor  nominations  and  peer  ratings  can  be  used.  (Recent 
reviews  by  Lewin  and  Zwany,  1976,  and  Kane  and  Lawler,  1979,  indi¬ 
cate  that  these  ratings  have  high  criterion  validity.)  Supervisory 
and  peer  ratings  can  in  some  cases  be  supplemented  with  client  or 
subordinate  ratings  (e.g.,  those  available  from  organizational  cli¬ 
mate  surveys) . 


(2)  Identify  Criterion  Sample 

Job  incumbents  who  are  consistently  rated  superior  on  a  number 
of  different  performance  criteria  provide  a  standard  for  comparison 
analyses  with  a  sample  of  average  performers  in  the  remaining  steps 
of  the  process. 


riGURE  1 


Schematic  of  the  Job  Competency  Assessment  Process 
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•  "hard  data":  sales,  profits,  productivity  measures, 
unit  performance  records  (e.g.,  ARTEP  scores, 
retention  rates) 

•  supervisor  nominations 

•  peer  ratings 

•  subordinate  ratings  (as  by  organizational  climate  surveys) 


etc.,  programs 


(3)  Job  Task/Function  Analysis 

A  job  task  or  function  analysis  by  traditional  time-log,  panel, 
or  direct  observation  methods  can  be  used  to  supplement  the  data 
collected  in  the  Job  Competence  Assessment  process,  although  for 
reasons  which  will  be  discussed  below,  this  method  is  less  useful 
in  identifying  critical  "soft  skills"  competencies,  because  job 
task  analyses  identify  the  characteristics  of  the  job  as  opposed 
to  those  of  the  people  who  do  the  job  well. 


(4)  Performance  Characteristics  Analysis 

A  panel  of  expert  incumbents  or  observers  of  the  job  to  be  — * 
analyzed  is  convened  to  develop  a  list  of  hypothesized  character¬ 
istics  of  people  who  do  the  job  well  (cf.  the  "Job  Element  Analysis" 
method  developed  by  Primoff,  1977).  Expert  panels  then  rate  each 
characteristic  on  four  scales: 

(1)  the  extent  to  which  it  distinguishes  superior  from  average 
performers; 

(2)  how  many  barely  acceptable  performers  possess  it; 

(3)  how  critical  it  is  for  selection  or  training;  and 

(4)  how  many  job  openings  one  could  realistically  expect  to 
fill  if  one  demanded  the  characteristic  or  skill  as  an 
entry  criteria. 

Statistical  analysis  of  these  ratings  provides  a  numerical 
ranking  of  those  characteristics  which  contribute  most  highly  to 
superior  performance  and  elimination  of  those  which  are  unrealistic 
or  appear  to  be  possessed  by  few  job  incumbents.1  This  analysis 
provides  a  set  of  hypotheses  about  critical  performer  competencies 
which  must  be  verified  by  behavioral  event  interview  or  direct  ob¬ 
servation  data. 


(5)  Behavioral  Event  Interview 


As  described  in  the  Foreign  Service  Officer  example,  superior 
and  average  performers  are  interviewed  in-depth  about  the  most 
critical  situations  they  have  encountered  and  hence,  the  most  im¬ 
portant  skills  and  competencies  required  of  them  in  their  actual 
jobs.  Behavioral  event  interview  protocols  provide  a  wealth  of  data 


1  An  element  will  be  rated  highly  (1)  if  it  distinguishes  the  superior 
performer;  (2)  if  very  few  barely  acceptable  performers  have  it; 

(3)  if  trouble  is  likely  if  it  is  not  considered  in  selection  or 
training;  and  (4)  if  it  is  realistic  to  fill  at  least  some  jobs  by 
demanding  it.  Conversely,  an  element  will  receive  a  low  rating 
(1)  if  it  does  not  distinguish  the  superior  performer;  (2)  if  al¬ 
most  all  barely  acceptable  performers  possess  it;  (3)  if  one  can  safely 
ignore  it  in  selection  and  training;  and  (4)  if  all  jobs  can  be 
filled  by  demanding  it.  (See  equations  in  Primoff,  197~.' 
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cific  description  of  job  behaviors.  (A  significant  "by-product 
of  these  interviews  is  the  generation  of  numerous  situation  and 
problem  narratives  which  can  be  used  to  develop  highly  relevant 
training  materials — e.g.,  case  studies  and  simulations.) 


spe- 
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(6)  Direct  Observation 


Where  possible,  direct  observation  can  be  used  to  verify  job 
task  analysis,  performance  characteristics,  hypotheses,  and  be¬ 
havioral  event  interview  data.  As  will  be  discussed  below,  empir¬ 
ical  "assessment  center"  behavioral  coding  schemes  (Bales,  1969; 
Bales,  Cohen,  &  Williamson,  1979)  provide  perhaps  the  most  valid 
method  of  measuring  soft  skill  competencies. 


(7)  Thematic  Analysis  and  Development  of  a  "Competency  Model" 

Data  from  the  job  task  performance  characteristic  analysis 
and  behavioral  event  interviews  are  subjected  to  a  rigorous  con¬ 
tent  analysis  procedure  to  identify  the  behavioral  patterns  and 
personality  characteristics  which  distinguish  superior  from  aver¬ 
age  job  incumbents.  This  is  the  most  difficult  and  creative  step 
in  the  JCA  process.  Two  or  more  trained  analysts  examine  the  data 
and  attempt  to  define  competency  elements  which  are  differentially 
present  or  absent  in  the  data  on  superior  as  compared  with  average 
performers.  These  elements  are  refined  until  they  can  be  recog¬ 
nized  with  acceptable  inter-rater  reliability.  A  detailed  and 
specific  "behavioral  code  book"  is  prepared  to  facilitate  empirical 
coding  of  interview  data.  These  data  are  then  used  to  test  the 
criterion  validity  of  the  model.  The  behavioral  code  book,  which 
describes  the  soft  skill  competencies  that  predict  performance  in 
the  job,  provides  the  "competency  model"  for  the  job. 


(8)  Validation  of  the  Competency  Model 

As  described  in  the  Foreign  Service  Officer  example,  the 
competency  model  derived  in  Step  7  can  be  cross-validated  by  (1) 
collecting  behavioral  event  interview  data  on  a  second  criterion 
sample  and  seeing  if  a  discriminant  functions  analysis  based  on 
the  first  study  predicts  successful  as  opposed  to  average  per¬ 
formers  in  the  second  sample;  and/or  (2)  constructing  objective 
tests  to  measure  the  competencies  derived  from  the  competency 
model  and  using  test  scores  from  a  second  criterion  sample  to  test 
the  model's  criterion  and  predictive  validity. 
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Application  of  the  Competency  Model 

Once  validated,  the  competency  model  can  be  used  in  a  variety 
of  ways:  as  the  basis  for  the  design  of  selection  tests,  assess¬ 
ment  centers,  performance  appraisal  systems  and  training  and  pro¬ 
fessional  development  programs,  and  as  a  source  of  criteria  for 
the  evaluation  of  training  programs. 


Comparison  of  Job  Competence  Assessment 
With  Other  Job  Analysis  Methods 

It  is  useful  to  examine  how  the  Job  Competence  Assessment 
method  differs  from  and  can  address  some  of  the  limitations  in 
traditional  job  analysis  techniques.  Three  traditional  approaches 
to  defining  selection  and  training  criteria  can  be  distinguished: 

(1)  Content  Knowledge  or  Theory-Based  Systems  which  specify,  on 
the  basis  of  theory,  the  knowledge  skills  which  should  be 
important  for  a  person  to  have  in  order  to  do  a  job. 

(2)  Expert  Panel:  the  characteristics  which  experts,  tasked 
to  determine  by  consensus,  think  are  important  for  a  per¬ 
son  to  have  in  order  to  do  the  job  (represented  in  the 
Job  Competence  Assessment  process  by  the  performance 
characteristics  analysis  step) . 

(3)  Job  Task/Function  Analysis:  identification  of  the  task 
functions  that  make  up  the  job  which  are  used  to  infer 
the  knowledge  and  skills  needed  by  the  people  who  occupy 
the  job. 

Theory  and  panel  methods  have  three  distinct  limitations. 

First,  they  lack  supporting  empirical  data  to  show  that  the 
knowledge  or  skill  characteristics  they  posit  are  in  fact  re¬ 
lated  to  on-the-job  performance.  An  example  was  the  humanistic 
psychology  courses  which  swept  the  military  a  few  years  back: 
Civilian  academic  management  theories  and  strongly-held  beliefs 
on  the  part  of  a  few  persons  led  to  the  implementation  of  "leader¬ 
ship"  courses,  which  taught  and  prescribed  "humanistic" 
communications  techniques  in  the  absence  of  any  data  to  show 
that  these  techniques  had  in  fact  anything  to  do  with  effective 
leadership  in  military  organizations. 

Second,  theory  and  panel  methods  tend  to  identify  so-called 
"folklore"  or  "motherhood"  items  (such  as  "integrity,"  "perser- 
verance"  or  "moral  courage")  which  sound  good  and  are  seen  as 
qualities  that  all  job  incumbents  should  have,  but  which  may  or 
may  not  be  related  to  performance  on  the  job.  For  example,  in  the 
State  Department  study,  "writing  skills"  was  agreed  upon  as  neces¬ 
sary  for  superior  performance  of  Foreign  Service  Officers.  The 
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Job  Competence  Assessment  process  found  that  despite  the  fact  that 
"everyone  knew"  that  writing  skills  were  important,  this  ability 
did  not  in  fact  differentiate  superior  from  average  performers. 

What  was  important  was  the  ability  to  write  with  sensitivity  to 
political  issues. 

The  third  shortcoming  of  theory  and  panels  is  that  the  data 
they  generate  are  not  sufficiently  behaviorally  specific  to  pro¬ 
vide  practical  selection  or  training  criteria.  For  example,  it 
is  difficult  to  define  "concern  for  people"  in  observable  terms. 

How  does  one  manifest  concern?  What  does  this  mean?  It  turns  out 
that  what  has  usually  been  identified  as  "concern  for  people,"  af¬ 
filiation  motivation,  or  the  desire  to  establish  close  friendly 
relations  with  others  has  consistently  been  found  to  be  negatively 
related  to  effective  performance  in  managerial  roles  (McClelland 
&  Burnham,  1976) .  Effective  concern  for  people,  at  least  for  indus¬ 
trial  and  military  leaders,  is  not  a  function  of  affiliation  needs, 
but  rather  the  combination  of  a  skill  called  accurate  empathy  (the 
ability  to  understand  what  others  are  saying)  and  power  or  influence 
skills  (the  ability  to  empower  others  to  make  them  feel  more  ca¬ 
pable  of  solving  their  own  problems) . 

Job  tasks/function  analysis  methods  also  have  limited  utility 
in  identifying  soft  skills.  The  unit  of  analysis  is  the  job,  not 
the  person  who  performs  the  job  well.  For  example,  a  job  task 
analysis  statement  for  a  mechanical  engineer  might  be  "designs  gears." 
This  is  accurate  enough  but  says  nothing  about  what  enables  an  en¬ 
gineer  to  design  a  gear  well .  Behavioral  event  interviews  with 
superior  engineers  indicate  that  they  have  an  underlying  competency 
which  might  be  labeled  "three  dimensional  eidetic  rotational  imagery." 
For  example,  in  behavioral  event  interviews,  better  engineers  de¬ 
scribed  an  ability  to  mentally  "image"  and  mutate  physical  objects 
in  three  dimensions,  imaging  different  configurations  until  they 
arrive  at  an  optimum  design.  Some  even  reported  bringing  other 
senses  into  play  as  well  (e.g.,  "I  sort  of  became  the  gear  and  tried 
to  feel  where  I  would  hurt  or  break  if  under  stress--sounds  crazy, 
but  it  led  me  to  'seeing'  'the  need  to  thicken  a  flange...").  This 
cognitive  competency  did  not  appear  in  average  engineers'  interview 
protocols.  Similarly,  in  studies  of  Army  Organizational  Effectiveness 
Staff  Officers  (internal  organizational  development  consultants) ,  an 
important  job  function  appeared  to  be  "contracting  with  clients" 

(i.e.,  negotiating  with  the  service  recipient  to  agree  on  just  what 
services  the  consultant  would  provide) .  This  functional  statement, 
however,  does  not  specify  what  consultant  skills  lead  to  effective 
contracting.  All  consultants  contract,  but  only  some  do  it  well. 

A  key  soft  skill  competency  in  this  case  proved  to  be  "accurate 
empathy":  more  effective  consultants  were  better  able  to  "hear" 

their  clients'  underlying  concerns. 

In  each  case,  job  task  analysis  methods  can  identify  what  people 
do,  but  not  the  nuances  of  professional  skill  that  enable  some  per¬ 
sons  to  perform  a  task  more  effectively  than  others.  Lists  of  tasks, 


such  as  "writes  memos"  or  "communicates  orally  to  subordinates," 
are  of  little  use  without  supplementary  information  about  the  com¬ 
petencies  a  superior  job  incumbent  uses  to  make  these  communications 
effective  (e.g.,  accurate  empathy,  political  sensitivity,  or  such 
influence  methods  as  assertive  persuasion) . 

Second,  job  task  analyses  tend  to  be  too  detailed  to  be  prac¬ 
tical  (e.g.,  lists  of  the  4,300  discrete  behaviors  required  in 
driving  a  car  or  the  3,001  functions  performed  by  a  teacher).  Such 
analyses  may  be  useful  for  describing  specific  technical  tasks  (for 
example,  the  steps  in  trouble-shooting  a  radio) ,  but  provide  too 
much  information  in  the  wrong  form  to  be  helpful  in  teaching  soft 
skills . 

Finally,  job  task  analyses  are  not  selective.  The  well-known 
Praeto  rule  indicates  that  only  a  critical  20  percent  of  the 
functions  a  person  performs  on  the  job  account  for  80  percent  of 
performance.  The  remaining  80  percent  of  all  job  functions  are 
routine  maintenance  activities  which  do  not  distinguish  successful 
from  average  performers.  Job  tasks/function  analysis  lists,  par¬ 
ticularly  in  the  absence  of  a  criterion  sample,  can  not  distinguish 
the  important  functions  from  all  the  functions  that  a  job  incumbent 
performs . 

The  Job  Competence  Assessment  method  overcomes  some  of  the 
limitations  of  theory,  panel,  and  job  task  analysis  techniques  and 
can  supplement  them  in  the  identification  of  critical  soft  skills. 
First  and  most  importantly,  the  JCA  method  goes  beyond  espoused 
theories  and  job  descriptions  to  identify  the  personal  characteris¬ 
tics  and  skills  important  to  effective  performance  of  specific  job 
functions. 

Second,  the  behavioral  event  interview  makes  it  possible  to 
document  these  soft  skill  competencies  with  sufficient  behavioral 
specifics  that  they  can  be  used  to  assess  and  train  others. 

Third,  the  JCA  method  is  selective:  The  critical  incident  in¬ 
terview  approach  necessarily  focuses  on  the  "critical  20  percent" 
of  knowledges,  skills,  abilities,  and  other  characteristics  most 
important  to  performance  as  opposed  to  the  large  number  of  ancillary 
behaviors  associated  with  routine  functions. 


Application  of  Job  Competence  Assessment 
Methods  to  Measuring  and  Training  Soft  Skills 

It  may  be  useful  to  briefly  describe  some  of  the  methods  de¬ 
veloped  from  the  Job  Competence  Assessment  procedure  for  measuring 
and  training  to  soft  skills. 
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There  are  three  commonly  used  "soft  skill"  assessment  methods: 

(1)  Pa^er-and-penci  1 _ tests  ot  knowledge  content,  cognitive 

ability  (e.g.,  critical  thinking  or  decision  making), 
and  personality  variables  (e.g.,  attention  to  detail 
and  concern  for  influence).  in  general,  operant  tests 
(e.g.,  essay  exams  or  projective  instruments),  which 
require  test-takers  to  generate  behavior,  are  more 
useful  than  respondent  measures  (e.g.,  multiple  choice 
exams)  which  ask  test-takers  to  choose  among  items. 

Reviews  suggest  the  criterion  validity  of  multiple-choice 
tests  rarely  exceeds  r  ■  .33  or  10  percent  of  the  ob¬ 
servable  variance  (Ghiselli,  1966;  Mischel,  1968). 

(2)  Superior  and/or  peer  ratings  of  job  incumbents  on  the 
basis  of  general  performance  or  aptitude  for  a  job. 

Recent  reviews  indicate  the  criterion  validity  of  such 
ratings  is  somewhat  better  than  that  of  paper-and- 
pencil  tests:  r  *»  .40  -  .45  or  16  -  20  percent  of  the 
variance  (Lewin  &  Zwany,  1976;  Kane  4.  Lawler,  1979). 

( J )  Observer  ratings  of  performance  on  simulated  job-specific 
tasks  (e.g.,  ratings  of  military  officer  performance  in 
such  assessment  center  exercises  as  giving  a  presentation 
or  managing  a  leaderless  group).  Reviews  of  the  predictive 
validity  of  assessor  scores  is  better  still:  r  .50  -  .60 
or  25  -  JO  percent  of  the  variance  (MacKinnon,  1975) . 

Our  research  indicates  that  operant  tests  are  much  more  ef¬ 
fective  in  measuring  soft  skills  than  are  respondent  knowledge  con¬ 
tent  tests.  For  example,  in  assessing  influence  skills,  it  is  much 
better  to  measure  individuals'  ability  to  make  an  effective  argument 
(an  operant  performance)  as  opposed  to  their  ability  to  recognize 
an  effective  argument  on  a  multiple-choice  test.  In  general, 
simulated  job  performance  tests  are  more  predictive  than  operant 
paper-and-penci 1  tests. 

Very  frequently,  the  operant  test  items  or  situations  and  test 
scoring  criteria  for  specific  soft  skill  competencies  can  be  derived 
from  behavioral  event  interview  data  and  the  behavioral  code  book 
which  describes  the  competency  model  for  a  job.  A  better  score  on 
such  tests  is  what  superior  performers  actually  do  as  opposed  to 
what  average  performers  do.  Two  examples  from  the  Navy  officer 
competency  model  may  be  helpful  here. 

Figure  2  provides  examples  from  an  operant  coding  system  for 
critical  thinking,  the  cognitive  ability  to  make  inferences  o\ 
draw  critical  distinctions  from  large  amounts  ot  confusing,  con¬ 
flicting  data,  and  cite  specific  data  to  support  one's  inference. 


FIGURE  2 


Example  from  an  Operant  Coding  System 
for  "Critical  Thinking" 

(from  Winter  i,  McClelland,  1978) 


Procedure;  a  subject  is  asked  to  compare  and  contrast  two 
conflicting  analyses  of  or  statements  about  a 
stimulus  or  set  of  data 


Coding  System  for  scoring  subjects'  response: 

-1;  no  critical  distinction  nor  inference;  affective 
bias  (e.g. ,  "I  liked  analysis  1  and  disliked 
analysis  2.") 

0:  no  critical  distinction  nor  inference;  no  affective 

bias 

+1:  critical  distinction  or  inference,  but  no  mention 
of  supportive  data  (e.g.,  "Analysis  1  identifies 
the  problem  as  X,  where  Analysis  2  identifies  it 
as  Y . " ) 

+2:  critical  distinction  with  mention  of  supportive 

data 

+3:  critical  distinction  or  inference  with  mention  of 
data  pro  and  con  one's  inference;  probabilistic  or 
weighted  reconciliation  of  conflicting  data 
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Critical  thinking  is  important  because  it  appears  to  be  a  generic 
competency  of  superior  performers  in  almost  every  field:  Better 
Navy  officers,  better  counselors,  better  organic  chemists,  better 
medieval  literature  students,  better  lawyers,  etc.  all  are  higher 
in  critical  thinking  ability. 

The  procedure  for  giving  this  test  is  to  ask  a  subject  to 
compare  and  contrast  two  conflicting  statements  or  analyses  of  a 
situation  or  set  of  data.  The  content  of  the  stimulus  or  data  is 
not  important.  It  can  be  drawn  from  any  knowledge  area  or  profession 
for  example,  two  conflicting  tactical  plans  for  an  infantry  officer, 
or  two  conflicting  analyses  of  the  same  organic  compound  for  an 
organic  chemist. 

The  coding  system  for  scoring  subjects'  operant  responses  is 
summarized  in  Figure  2.  At  low  levels  of  critical  thinking,  sub¬ 
jects  are  unable  to  make  a  critical  distinction  or  inference  be¬ 
tween  the  two  sets  of  data  and  may  show  affective  biases  (e.g.,  "I 
liked  Analysis  1  and  disliked  Analysis  2").  At  higher  levels  of 
critical  thinking,  persons  are  better  able  to  make  critical  dis¬ 
tinctions  or  inferences,  cite  data  to  support  their  positions,  and 
reconcile  conflicting  data  pro  and  con  their  inferences  (i.e., 
reason  probabilistically  or  reconcile  conflicting  data  by  weighting 
opposing  statements) . 

Subjects'  behavioral  event  interview  protocols  can  be  coded 
for  this  dimension,  as  can  their  memoranda,  arguments  in  leader¬ 
less  case  discussions,  essay  responses  to  problem  analysis  tests, 
and  the  like. 

A  second  example  of  operant  coding  of  a  critical  soft  skill 
competency,  "accurate  empathy"  or  understanding,  is  provided  in 
Figure  3.  This  is  a  generic  competency  evidenced  by  superior  per¬ 
formers  in  a  wide  range  of  professional,  managerial,  and  human 
service  workers  jobs. 

For  example,  a  somewhat  surprising  finding  of  our  Job  Competence 
Assessment  studies  of  Navy  officers  was  that  they  spent  a  sizable 
amount  of  their  time  counseling  subordinates,  and  that  superior 
officers  were  significantly  more  proficient  in  counseling  skills. 

The  coding  and  scaling  system  provided  in  Figure  3  is  taken  from  a 
competency-based  training  module  designed  to  teach  naval  officers 
advising  and  counseling  skills. 

Accurate  empathy  is  an  assessment  of  the  extent  to  which  the 
person  can  accurately  hear  the  content,  meaning,  and  feeling  of 
what  another  person  is  saying.  This  variable  is  measured  by  coding 
the  response  a  subject  makes  to  a  live,  audio-tape,  or  written 
stimulus  statement  made  by  a  "counselee."  The  coding  system  for 
accurate  empathy  recognizes  three  elements:  the  respondent’s  ac¬ 
curacy  as  to  (1)  the  content  of  what  the  counselee  is  talking 
about;  (2)  the  counselee 1 s  meaning  (i.e.,  why  he  or  she  is  concerned 
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FIGURE  3 


Example : 

An  Operant  Coding  System  for  "Accurate  Empathy" 
(from  Carkhuff,  1969) 


Procedure;  a  subject  is  asked  to  make  an  appropriate 
counseling  response  to  a  taped  or  live 
statement  made  by  a  "counselee" 


Understanding  (accurate  empathy) ;  measures  the  extent  to  which  * 
the  counselor  accurately  hears  the  content,  meaning,  and  feeling 
(type  of  feeling  and  intensity  of  feeling)  of  what  the  counselee 
is  saying. 

4 

•  Content ;  what  the  person  is  talking  about — his  wife, 
her  job,  an  alcohol  problem,  etc. 

•  Meaning;  why  the  person  is  talking  about  it — "You  are 
talking  about,  because..."  (e.g.,  wife,  because  she's 
leaving  him;  job,  because  she's  not  doing  it  as  well  as 
she  could,  etc.) 

•  Feeling;  how  the  person  feels — the  feeling  word  the 
person  uses. 

— type  of  feeling:  sad,  angry,  frustrated 

— intensity  of  feeling:  for  example,  for  anger, 

where  on  a  scale  from  "mildly  irked"  to  "blind  rage" 

For  example,  to  a  person  who  has  received  a  "Dear  John"  letter, 
the  counselor  says: 


UNDERSTANDING 


© 

© 

© 

© 

Content, 
meaning , 
feeling 
absent  or 
wrong 

Content 
accurate ; 
meaning, 
feeling 
absent  or 
wrong 

Content 
and  meaning 
accurate; 
feeling  in¬ 
accurate  or 
wrong 

Content, 
meaning , 
feeling  all 
accurate 

"Nice  weather, 
isn't  it?" 

"So  what? — 
get  back  to 
work . " 


"Sounds  like 
you  got 
marriage 
problems. " 


"Your  perfor¬ 
mance  was  off 
today  because 
you  got  some 
bad  news . " 


"You  were  too  up¬ 
set  to  work 
because  you  got 
that  letter  from 
your  wife." 
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about  the  content);  and  (3)  the  counselee's  feeling ,  both  the 
type  of  affect  and  the  intensity  of  affect  expressed  about  the 
content  and  meaning. 

For  example,  at  a  low  level  of  accurate  empathy,  a  Navy  of¬ 
ficer  may  respond  to  a  subordinate  who  has  received  a  "Dear 
John"  letter  with  a  curt,  "Tough  luck.  Get  back  to  work.",  or  a 
completely  content-irrelevant  response  such  as,  "Nice  weather, 
isn't  it?"  At  higher  levels  of  accurate  empathy,  the  officer 
understands  and  reflects  the  subordinate's  feelings  in  the  con¬ 
text  of  their  content  and  meaning  (e.g.,  "You're  really  shook 
up  because  of  that  letter  you  got  from  your  wife.").  A  response 
of  this  type  makes  the  subordinate  feel  understood  and  facilitates 
his  or  her  coping  with  stressful  feelings. 

A  large  body  of  literature  indicates  that  accurate  empathy 
is  a  critical  competency  for  all  types  of  professionals  (e.g., 
doctors  or  lawyers,  persons  in  helping  positions)  (Carkhuff  & 
Berenson,  1976) .  More  recently,  it  has  also  been  found  to  be 
a  critical  skill  for  leaders  and  managers,  underlying  what  is  called 
"concern  for  people."  *  (It  should  be  emphasized  that  accurate  empathy 
is  not  sympathy,  feeling  what  the  other  feels,  but  rather  under¬ 
standing,  knowing  what  the  other  feels,  which  enables  a  manager 
to  make  the  appropriate  response  to  help  a  subordinate  solve  a  per¬ 
sonal  problem.) 

The  important  thing  about  such  operant  coding  systems  for 
any  soft  skill  competency  is  that  they  are  both  highly  interrater 
reliable  (i.e. ,  can  be  accurately  recognized)  and  demonstrate  pre¬ 
dictive  validity  (i.e.,  can  be  shown  to  be  causally  related  to 
superior  job  performance) .  Perhaps  even  more  importantly,  once 
soft  skills  can  be  defined  in  this  level  of  behavioral  detail, 
they  can  be  readily  taught  to  others;  which  leads  me  to  my  final 
subject,  training  in  soft  skills. 


Training  in  Soft  Skills 

Until  recently,  many  educators  have  been  skeptical  about  the 
extent  to  which  it  is  possible  to  teach  or  train  people  in  such 
soft  skill  competencies  (e.g.,  achievement  motivation,  critical 
thinking,  accurate  empathy,  or  skillful  use  of  influence) .  Over 
the  past  25  years,  McClelland  (McClelland  &  Winter,  1971)  has  con¬ 
clusively  shown  that  achievement  motivation,  an  important  cognitive 
affective  competency  which  predicts  success  in  jobs  requiring  entre¬ 
preneurial  initiative,  can  be  taught.  The  method  McClelland  pre¬ 
scribes  for  training  to  such  a  competency  is  relatively  simple. 

It  involves  (1)  teaching  people  the  behavioral  coding  system  for 
the  competency  in  great  detail;  (2)  practice  in  assessing  their 
own  and  other's  behaviors  in  achievement  motivation  terms;  (3)  set¬ 
ting  specific  goals  and  defining  action  steps  for  using  the 


competency,  first  in  a  supportive  training  environment,  and  then  in 
creasingly  in  real  life.  Persons  trained  in  achievement  motiva¬ 
tion  show  significant  increases  in  personal  income,  career 
advancement,  business  sales  and  profits,  and  create  more  capital 
and  jobs.  (Miron  &  McClelland,  1979) . 

In  recent  work  in  developing  competency-based  leadership  and 
management  courses  for  the  United  States  Navy,  McBer  has  developed 
a  fairly  standard  five-step  competency  training  procedure  (Spencer, 
1978)  which  incorporates  and  expands  upon  McClelland’s  principles. 

I  will  briefly  describe  how  each  of  these  steps  is  used  to  teach 
the  two  competencies  discussed  above  under  measurement  of  soft 
skills,  critical  thinking,  and  accurate  empathy. 


Recognition 

Trainees  are  presented  with  a  difficult  case  or  a  simulation 
problem-designed  to  produce  a  "shock  of  recognition"  in  which  they 
realize  that  they  actually  encounter  problems  calling  for  the  use 
of  the  competency  in  question  in  their  real  jobs,  and  that  they 
often  have  trouble  dealing  with  these  problems.  For  example, 
trainees  may  be  given  a  complex  analytical  task  which  requires  cri¬ 
tical  thinking  or  be  asked  to  counsel  a  subordinate  in  distress 
in  a  role-play.  The  cases  and  simulations  used  are  drawn  from 
actual  critical  incidents  collected  during  the  behavioral  event 
interview  phase  of  the  Job  Competence  Assessment  process.  The 
recognition  step  is  designed  to  introduce  the  competency  in  an 
experiential  way  and  create  specific  motivation  for  learning. 


Explanation 

Trainees  receive  practical  conceptual  input  on  the  competency 
via  readings,  lectures,  or  demonstrations.  For  example,  in  the 
module  on  critical  thinking,  trainees  are  given  a  lecture  on  the 
importance  of  critical  thinking  in  their  field,  are  taught  the 
critical  thinking  coding  system,  and  score  actual  case  problem 
analyses  for  critical  thinking.  In  a  counseling  module,  trainees 
are  similarly  taught  the  accurate  empathy  scoring  system  and  then 
code  video-taped  demonstrations  illustrating  lower  and  higher 
stages  of  empathy  behavior.  Recent  research  indicates  that  trainees 
can  quickly  acquire  a  very  high  degree  of  reliability  (r  =  .95+) 
when  exposed  to  behaviorally  specific  examples  of  discrete  points 
on  a  scale  (Lawton  &  Borman,  1978). 


Self-Assessment 


Trainees  receive  operant  test  feedback  on  their  performance 
on  the  competency  factors  which  predict  superior  performance.  This 
feedback  in  effect  tells  them,  "This  is  how  the  superstars  in  your 
billet  perform  on  these  dimensions,  and  this  is  how  you  perform," 
which  provides  trainees  with  very  specific  motivation,  direction, 
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and  goals  for  change.  Knowledge  of  the  behavioral  coding  scheme 
imparted  in  Step  2  enables  trainees  to  grasp  quickly  and  see  exactly 
what  they  are  doing  effectively  or  ineffectively  in  terms  of  a  given 
soft  skill  competency. 


Skill  Practice 


Trainees  practice  using  the  competency  skills  they  have  been 
taught.  For  example,  the  best  way  of  practicing  critical  thinking 
is  repeated  exposure  to  analytic  case  discussions  of  the  type 
pioneered  by  Harvard's  Law  and  Business  Schools.  Students  who  are 
repeatedly  asked  to  analyze  complex  case  problems  to  respond  to  the 
insistent  questions  "What's  the  problem?  Who  has  it?  What  are 
your  data?"  rapidly  gain  in  the  ability  to  draw  critical  distinctions 
and  inferences  from  complex  information.  (Incidentally,  our  studies 
indicate  that  the  case  method  effectively  teaches  two  competencies; 
critical  thinking  and  assertive  persuasion  skills,  the  ability  to 
"think  on  one's  feet"  and  articulately  defend  one's  analysis  of  a 
situation,  or  proposed  solution  to  a  problem.) 

In  practicing  accurate  empathy,  students  conduct  repeated  real 
or  simulated  counseling  sessions  which  are  recorded  on  video  or 
audio  tape,  then  play  back  and  score  their  responses  on  the  accurate 
empathy  scale,  continuing  this  process  until  they  reach  a  mean 
level  of  3  on  a  4-point  scale,  the  level  which  predicts  successful 
performance  (Carkhuff  &  Berenson,  1976). 


Job  Application 

In  the  final  step,  trainees  identify  situations  in  which  they 
will  use  the  competency  in  their  jobs  and  set  goals,  anticipate 
obstacles,  and  develop  an  action  plan  for  doing  so.  This  step 
reinforces  the  relevance  of  the  training,  translates  it  back  into 
a  real  job  performance  context,  and  increases  the  likelihood  that 
any  soft  skill  competency  learned  will  be  in  fact  used  back  on 
the  job. 

In  summary,  the  Job  Competence  Assessment  process  identifying, 
measuring,  and  training  soft  skills  provides  a  number  of  benefits. 

It  permits  description,  in  very  specific  behavioral  terms,  not 
only  of  the  elements  of  a  job  but  the  characteristics  and  skills 
of  the  persons  who  do  the  job  well.  These  behavioral  indices  can 
be  used  in  a  variety  of  personnel  functions;  development  of  non- 
discriminatory  selection  tests  and  interview  processes  and 
competency-based  performance  appraisal,  "efficiency"  or  evaluation 
reports,  and  the  design  and  evaluation  of  training  programs. 
Competency-based  selection,  assessment,  and  training  procedures 
provide  empirical,  reliable,  predictively  valid  and  face  valid 
methods  of  defining  the  soft  skills  associated  with  competent  job 
performance:  what  superior  incumbents  actually  do  in  their  real  jobs. 
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Schematic  of  the  Job  Competency  Assessment  Process. 


Define 


Performance 

Effectiveness 

Criteria 

I  : 

Identify 


•  "hard  data":  sales,  profits,  productivity  measures, 

unit  performance  records  (e.g.,  ARTEP  scores, 
retention  rates)  .  * 

•  supervisor  nominations  -  j 

•  peer  ratings 

•  subordinate  ratings  (as  by  organizational  climate  surveys) 


etc.,  programs 


FIGURE  2 


Example  from  an  Operant  Coding  System 
for  "Critical  Thinking" 

(from  Winter  &  McClelland,  1978) 


Procedure:  a  subject  is  asked  to  compare  and  contrast  two 
conflicting  analyses  of  or  statements  about  a 
stimulus  or  set  of  data 


Coding  System  for  scoring  subjects'  response: 

-1:  no  critical  distinction  nor  inference;  affective 
bias  (e.g.,  "I  liked  analysis  1  and  disliked 
analysis  2.") 

0:  no  critical  distinction  nor  inference;  no  affective 
bias 

+1:  critical  distinction  or  inference,  but  no  mention 
of  supportive  data  (e.g.,  "Analysis  1  identifies 
the  problem  as  X,  where  Analysis  2  identifies  it 
as  Y. ") 

+2:  critical  distinction  with  mention  of  supportive 

data 

+3:  critical  distinction  or  inference  with  mention  of 
data  pro  and  con  one's  inference;  probabilistic  or 
weighted  reconciliation  of  conflicting  data 


FIGURE  3 


Example : 

An  Operant  Coding  System  for  "Accurate  Empathy" 
(from  Carkhuff,  1969) 


Procedure:  a  subject  is  asked  to  make  an  appropriate 

counseling  response  to  a  taped  or  live 
statement  made  by  a  "counselee" 


Understanding  (accurate  empathy) :  measures  the  extent  to  which 
the  counselor  accurately  hears  the  content,  meaning,  and  feeling 
(type  of  feeling  and  intensity  of  feeling)  of  what  the  counselee 
is  saying. 

•  Content:  what  the  person  is  talking  about — his  wife, 
her  job,  an  alcohol  problem,  etc. 

•  Meaning:  why  the  person  is  talking  about  it — "You  are 
talking  about,  because..."  (e.g. ,  wife,  because  she's 
leaving  him;  job,  because /she ' s  not  doing  it  as  well  as 
she  could,  etc.) 

•  Feeling:  how  the  person  feels — the  feeling  word  the 
person  uses. 

— type  of  feeling:  sad,  angry,  frustrated 

— intensity  of  feeling:  for  example,  for  anger, 

where  on  a  scale  from  "mildly  irked"  to  "blind  rage" 

For  example,  to  a  person  who  has  received  a  "Dear  John"  letter, 
the  counselor  says: 


UNDERSTANDING 
®  © 


Content, 

Content 

Content 

Content, 

meaning, „ 

accurate ; 

and  meaning 

meaning , 

feeling  • 

.  meaning, 

accurate; 

feeling  all 

absent  or 

feeling 

feeling  in- 

accurate 

wrong  ■>  . 

absent  or 

accurate  or 

wrong 

wrong 

"Nice  weather, 
isn't  it?" 

"So  what? — 
get  back  to 
work. " 


"Sounds  like 
you  got 
marriage 
problems. " 


"Your  perfor¬ 
mance  was  off 
today  because 
you  got  some 
bad  news. " 


"You  were ''too  up¬ 
set  to  work 
because  you  got 
that  letter  fro*, 
your  wife." 


THE  NAVY  LEADERSHIP  AND  MANAGEMENT  TRAINING 
PROGRAM:  A  COMPETENCY-BASED  APPROACH 


Lyle  M.  Spencer,  Jr.,  Ph.D. 
McBer  and  Company 
137  Newbury  Street 
Boston,  Massachusetts  02II6 


Introduction 

This  paper  will  briefly  summarize  the  research  underlying  the  Navy's  new 
Leadership  and  Management  Training  Programs. 

In  1975,  under  the  leadership  of  CDR  Dana  French,  the  Navy's  Bureau  of 
Personnel  (BUPERS)  initiated  a  study  of  the  Navy's  existing  leadership  and 
management  training  efforts.  This  study  (CNET,  1975)  produced  a  number  of 
interesting  findings. 

First,  it  was  found  that  a  majority  of  naval  commissioned  and  non¬ 
commissioned  officers  did  not  receive  any  leadership  and  management  training 
at  key  ascension  points  in  their  careers.  Figure  1  shows  the  key  ascension 
points  for  commissioned  officers — source  school  conversion  training  when 
people  enter  the  service,  then  division  officer,  department  head,  staff, 

XO,  CO,  and  Flag  positions,  and  shows  the  number  of  empty  cells,  points  at 
which  officers  do  not  now  receive  training.  Figure  2  shows  the  comparable 
ascension  points  for  enlisted  personnel — recruit  (boot  camp  training),  petty 
officer,  leading  petty  officer,  leading  chief  petty  officer,  and  master 
chief  petty  officer  (E9s  in  the  position  of  senior  enlisted  person  in  com¬ 
mand) — and  shows  the  empty  cells,  points  at  which  noncommissioned  officers 
do  not  receive  training. 

Second,  even  where  leadership  training  was  shown  to  exist,  it  was  often 
very  limited  (for  example,  as  few  as  four  hours  in  a  two-month  technical 
school).  Technical  training  received  overwhelming  emphasis — up  to  95  per¬ 
cent  of  the  prospective  officer's  curriculum — despite  the  evidence  that 


Adapted  from  L.  M.  Spencer,  Jr.,  The  Navy  leadership  and  management  train¬ 
ing  program:  A  competency-based  approach.  In  Proceedings:  Psychology  in 
the  Department  of  Defense,  Sixth  Symposium,  United  States  Air  Force  Academy, 
Colorado  Springs,  Colorado,  April  1978. 
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(1)  officers  spent  50  percent  of  their  time  on  personnel  (as  opposed  to 
technical)  management,  and  (2)  competence  in  managing  people  is  more  predic¬ 
tive  of  their  overall  effectiveness,  especially  as  they  attain  higher  rank. 
Technical  training  alone  is  not  enough.  The  conclusion  was  that  most  Navy 
leaders  did  not  receive  adequate  training  in  leadership  and  management  at 
the  key  points  in  their  careers  when  they  had  to  assume  increased  management 
responsibility. 

The  recent  history  of  Navy  Leadership  and  Management  training  efforts 
has  included  two  major  initiatives: 

1.  Human  Resource  Management  (HRM):  education,  attitude  change  and 
organization  development  programs  concerned  with  Navy  people  problems — 
racism,  sexism,  drug  and  alcohol  abuse — and  command  climate.  These  pro¬ 
grams  were  a  response  to  major  personnel  problems  the  Navy  encountered  in 
the  late  1960s  as  a  result  of  the  Vietnam  war,  all-volunteer  military  ser¬ 
vice,  changing  youth  culture,  and  racial  tensions  in  American  society.  A 
major  Congressional  study,  the  Hicks  report  (Hicks,  1973),  found  that  the 
single  most  important  factor  in  these  problems  was  lack  of  leadership  and 
management  skills  of  Navy  middle  management  personnel.  HRM  programs  ef¬ 
fectively  focused  Navy  attention  on  important  problems,  but  it  has  been 
found  that  "preaching"  at  people  has  relatively  little  power  to  change 
their  behavior.  Further,  it  has  always  been  the  premise  of  Navy  HRM  pro¬ 
grams  that  if  Navy  leaders  were  doing  their  jobs,  the  need  for  collateral 
"people  problem  programs"  would  be  substantially  reduced.  This  led  to  the 
Navy's  development  of  leadership  and  management  training. 

2.  Leadership  and  Management  Training  (LMT):  one-  and  two-week  courses 
on  management  theory  and  behavioral  science,  given  at  San  Diego  and  Little 
Creek.  LMT  courses  were  well  received  (one  indication  of  the  extent  to 
which  Navy  supervisors  felt  they  needed  more  management  training),  but  an 
examination  of  the  content  of  these  courses  found: 

•  There  was  no  standard  curriculum  or  consensus  about  what  knowledge  or 
skills  were  needed  to  perform  effectively  as  a  Navy  leader.  Courses 
consisted  of  a  potpourri  of  Navy  tradition,  rules,  and  regulations; 
civilian  academic  management  theories  (e.g.,  Maslow,  Herzberg,  & 
McGregor);  and  a  few  offerings  from  the  behavioral  sciences — organi¬ 
zational  behavior,  communications,  transactional  analysis,  and  the 
like . 

•  Courses  lacked  any  foundation  in  empirical  research  (i.e.,  there  were 
no  data  to  show  that  anything  taught  in  these  courses  had,  in  fact, 
any  relation  to  effective  leadership  and  management  in  Navy  billets). 

•  Courses  were  90  percent  cognitive  and  10  percent  experiential  (i.e., 
consisted  primarily  of  talking  at  people  about  leadership  and  manage¬ 
ment  in  formal  classroom  lecture  formats  rather  than  teaching  them 
practical  leadership  and  management  skills  in  realistic,  "hands  on" 
contexts) . 
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Moat  Navy  participants  reported  that  they  liked  these  courses,  but  that  they 
experienced  difficulty  relating  what  they  had  learned  to  their  actual  jobs. 

The  Research  Effort 

to  Identify  Navy  Leadership  Competencies 

To  address  the  limitations  identified  in  existing  courses,  BUPERS 
decided  to  develop  a  new  leadership  and  management  program  based  on  empiri¬ 
cally  derived  competencies:  those  knowledge,  skill,  and  motivation  vari¬ 
ables  which  could  actually  be  shown  to  predict  effective  performance  in 
Navy  leadership  billets. 

The  research  method  used  to  identify  these  competencies  was  a  job  com¬ 
petency  assessment  procedure  developed  by  Professor  David  C.  McClelland  at 
Harvard  University  (McClelland,  1975).  This  procedure  consists  of  three 
steps . 

(1)  Identification  of  a  criterion  sample  of  exemplary  (top  five  per¬ 
cent),  superior,  and  average  billet  incumbents  at  each  ascension 
point  from  the  three  Navy  communities  (air,  surface,  and  submarine 
commands)  in  the  Atlantic  and  Pacific  Fleets. 

(2)  Behavioral  event  interviews  with  sample  subjects.  These  interviews 
elicited  very  detailed  accounts  of  the  critical  management  incidents 
actually  faced  by  Navy  leaders.  The  interviews  accomplished  this 
through  use  of  a  narrative  format:  what  led  up  to  the  situation, 
who  was  involved,  what  the  motives  of  the  key  actors  were,  what  the 
respondent  actually  did,  and  what  outcomes  resulted  from  actions 
taken. 

(3)  Analysis  of  interview  incidents  to  identify  motives,  skills,  and 
behaviors  which  (1)  differentiated  superior  from  average  officers, 
and  (2)  all  officers  needed  to  have  in  order  to  perform  adequately 
in  their  jobs. 

Interview  data  were  empirically  coded  for  each  of  these  variables, 
providing  quantitative  scores  which  could  be  used  in  statistical  tests  of 
their  power  to  predict  subjects'  criterion  ratings. 

Approximately  200  respondents  were  interviewed,  yielding  about  900  scor- 
able  behavioral  events.  Thematic  analysis  of  a  subsample  of  these  protocols 
identified  27  reliably  identifiable  competency  characteristics.  All  events 
described  by  rated  officers  in  the  Atlantic  and  Pacific  Fleet  samples  were 
then  scored  "blind"  by  trained  scorers  who  had  achieved  a  mean  interrater 
reliability  of  r*.86.  Competency  variable  scores  for  all  subjects  were  then 
factor  analyzed,  yielding  five  competency  factors  (Klemp,  Munger,  &  Spencer, 
1977): 


(1)  Task  Achievement 

(2)  Management  Control 

(3)  Skillful  Use  of  Influence 

(A)  Coercion 

(5)  Advising  and  Counseling 

The  competency  factors  were  tested  in  a  double  cross  validation  design 
in  which  the  discriminant  function  analysis  coefficients  predicting  superior 
performance  in  one  Navy  fleet  were  used  to  predict  ratings  in  the  opposite 
fleet.  Stepwise  discriminant  analysis  yielded  standardized  coefficients  for 
all  competency  factors  except  Coercion,  which  did  not  distinguish  superior 
from  average  officers. 

The  PACFLT  discriminant  function  correctly  classified  41  of  the  51  rated 
officers  (80.4  percent)  in  the  PACFLT  sample  and  55  of  the  78  officers  in 
the  LANTFLT  sample  (70.6  percent).  The  LANTFLT  discriminant  function  cor¬ 
rectly  classified  58  of  the  78  rated  officers  (74.4  percent)  in  the  LANTFLT 
sample  and  36  of  the  51  rated  officers  (70.6  percent)  in  the  PACFLT  sample. 
The  average  of  the  phi  coefficients  obtained  in  each  cross-predicted  sample 
was  .46,  significant  at  the  p>  .001  level  and  a  reasonable  estimate  of  the 
predictive  power  of  the  four-factor  competency  model  when  applied  to  an  in¬ 
dependent  sample.  No  significant  rating  or  competency  differences  were 
found  for  superior  officers  in  the  Atlantic  and  Pacific  Fleets  or  among  the 
air,  surface,  or  submarine  communities.  These  data  suggest  that  the  rating 
standards  were  relatively  unbiased  and  that  competencies  identified  are  ap¬ 
plicable  to  the  Navy  as  a  whole.  In  a  second  cross-validation  study,  a  test 
battery  designed  to  measure  the  competencies  was  administered  to  983  Naval 
officers,  472  from  the  Atlantic  Fleet  and  511  from  the  Pacific  Fleet.  Test 
variables  predicted  subject  performance  ratings  at  R*.58  (Winter,  1978,  p. 
63).  Consolidation  of  the  validation  research  on  Navy  leadership  and 
management  competencies  (Winter,  1979)  identified  16  competencies,  grouped 
in  five  competency  factors  for  instructional  purposes  (see  Figure  3); 

1.  Concern  for  Efficiency  and  Effectiveness 

2.  Management  Control 

3.  Skillful  Use  of  Influence 

4.  Advising  and  Counseling 

5.  Problem  Solving 

Three  threshold  skills  (achievement  motivation,  power  motivation,  and 
technical  competence)  which  did  not  differentiate  between  superior  and 
average  performance  but  were  expressed  by  a  majority  of  all  Navy  officers, 
were  also  identified. 
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Concern  for  Efficiency  and  Effectiveness 


Superior  officers  reported  more  incidents  in  which  they  expressed  con¬ 
cern  for  achievement,  set  specific  goals  and  performance  standards,  and  took 
initiative  to  solve  technical  and  managerial  problems. 

The  following  incident  illustrates  the  competencies  involved  in  the 
Concern  for  Efficiency  and  Effectiveness  factor. 

(Aircraft  squadron  CO):  "When  I  took  over  the  squadron,  the  first 
thing  I  did  was  get  all  the  flight  records  going  back  six  months.  We 
weren't  doing  nearly  as  well  as  the  other  squadrons,  and  I  told  the 
wardroom  that  I  said  I  wanted  us  to  be  the  best,  and  that  we  would 
increase  our  flight  hours  every  week  until  we  were.  Mostly  it  was  a 
matter  of  showing  people  how  to  plan,  to  count  the  days,  figure  out 
what  to  accomplish  each  day,  personnel,  materials,  who  goes  where, 
when,  what  needs  to  be  done,  when,  and  who  does  it,  down  to  the  lowest 
airman.  I  got  all  the  LCDRs  together,  showed  them  how  to  look  at  all 
elements  that  were  going  to  occur  in  the  future,  how  to  develop  a  plan 
of  attack... Six  months  later,  we've  got  the  most  hours  flown  in  the 
group." 

In  this  case,  the  CO  expressed  a  concern  with  improving  perform¬ 
ance,  and  set  goals  and  standards  to  achieve  his  objective. 


Management  Control 

Superior  officers  were  more  likely  to  report  incidents  in  which  they 
planned  and  organized  tasks,  matched  people  and  resources  to  jobs, 
delegated  responsibility,  monitored  or  followed  up  to  be  sure  jobs  got 
done,  and  rewarded  or  disciplined  subordinates  on  the  basis  of  their 
performance. 

The  following  incident  illustrates  this  factor. 

(CO,  submarine):  "I  started  planning  for  the  inspection  six  months 
ahead  of  time.  If  you  don't  do  that,  you're  always  fighting  fires  and 
you  never  get  on  top  of  it.  Crisis  management  I  don't  like.  I  laid  it 
all  out  ahead  of  time  (shows  interviewer  elaborate  PERT  chart).  I  make 
sure  every  guy  knows  his  job.  (Interviewer:  "How?")... I  tell  'em... each 
gets  his  chunk  of  the  plan. . .(shows  interviewer  thick  folder  with  "to 
do"  lists  for  each  department)  and  knows  where  he  fits  with  the  others. 

I  let  them  run  with  it,  but  haul  them  in  every  week  to  see  where  they're 
at,  what's  going  okay  and  what  ain't.  I  don't  let  things  slip.  I've 
got  a  tickler  system  (shows  interviewer  three-inch  stack  of  NCR  forms 
referenced  by  due  dates).  If  someone's  on  track,  I  give  them  a  big 
'atta  boy,'  encouragement  to  keep  going.  If  not,  I  tell  them  I'm  going 
to  call  back — once.  The  second  time  I  have  to  call,  they  have  a  little 
chat  with  the  XO  or  me." 


EXHIBIT  3 


Navy  Leadership  Competency  Factors  and  Component  Competencies 


CONCERN  FOR  EFFICIENCY  AND  EFFECTIVENESS  (Task  Achievement) 

•  Achievement  motivation?  concern  with  improving  task 
performance 

1.  Sets  goals  and  performance  standards 

2*  Takes  initiative;  personal  responsibility  and  immediate 
action  to  solve  problem 

MANAGEMENT  CONTROL 

1 •  Plans  and  organizes:  prioritizes  and  schedules  tasks 

2*  Optimizes  use  of  resources:  matches  people  and  material  to 
tasks 

3.  Delegates:  appropriately  assigns  tasks  to  subordinates 

4.  Monitors  results:  follows  up  to  see  if  tasks  are  performed 
to  standards 

5.  Rewards  and  recognizes  good  task  performance 

6.  Disciplines  (punishes) 

SKILLFUL  USE  OF  INFLUENCE 

•  Power  motivation:  aware  of  and  concerned  with  influence 
1 •  Emotional  self-control 

2.  Influences :  up,  across,  and  down  chain  of  command  to 
accomplish  tasks  and  maintain  organizations 

3*  Develops  subordinates  (coaches):  teaches  others  how  to  improve 
performance 

Team  builds:  promotes  a  sense  of  work  group  identity, 
cohesion,  cooperation,  and  commitment 

ADVISING  AND  COUNSELING 

Positive  expectations:  expresses  positive  concern  for  and 
belief  in  others 

2*  Realistic  expectations:  accurately  perceives  others'  strengths 
and  weaknesses 


3.  Understands:  seeks  out,  shows  interest,  and  listens  to 
persons  with  problems;  accurately  hears  others'  problems 

4'  ~kye terra is tP  help’  8ugge8t8  «lternatives  or  appropriate 


CONCEPTUAL  THINKING 

1.  Conceptualises :  identifies  and  solves  managerial  and  organi 
zational  problems 

•  Technical  competence:  knows  technical  aspects  of  job, 
identifies  and  solves  technical  problems 

*  Threshold  skills  which  do  not  differentiate  superior  from 
average  performers  but  are  needed  and  used  by  all  Navy 
officers 


\ 
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Superior  officers  reported  planning  ahead  and  feeling  in  control  of 
events*  Average  officers  expressed  feelings  of  always  being  behind,  over¬ 
whelmed  by  external  system  demands,  and  powerless  to  avoid  continued  crisis 
management. 

Skillful  Use  of  Influence 

Superior  officers  were  more  concerned  with  influence  (i.e.,  higher  in 
power  motivation),  and  used  more  influence  methods — persuasion,  explanation, 
inspiration,  rewards — to  accomplish  their  objectives  and  motivate  subordi¬ 
nates  to  work  as  a  team. 

The  following  incident  illustrates  the  competencies  involved  in  the 
Skillful  Use  of  Influence  factor. 

(3M7):  "I  went  in  there,  junior  to  everyone  else,  and  I  knew  I  had  a 
better  way.  These  people'd  been  doing  it  the  same  way  for  15  years— it 
was  their  baby  and  they  had  real  ownership  in  it.  I  wanted  subtly  to 
convince  them  my  way  was  best.  I  did  this  by  proposing  new  ways  that 
were  almost  complete,  but  which  they  could  make  a  real  contribution  to — 
so  they  owned  it,  too.  I  kept  my  cool  and  let  them  get  lots  of  wins 
off  me  on  little  stuff  so  they  always  felt  they  were  on  top — though  I 
got  the  big  ones  I  wanted  through." 

In  this  example,  the  officer  expressed  concern  with  influence,  controlled 
his  emotions,  and  effectively  influenced  people  and  events  in  the  direction 
he  wanted,  while  promoting  a  sense  of  cooperation  among  his  team  members. 

Use  of  coercive  power  did  not  differentiate  superior  from  average 
leaders.  Superior  officers  were  less  likely  to  use  coercion  but  did  report 
more  incidents  in  which  they  disciplined  subordinates.  Perhaps  because 
they  were  more  concerned  with  standards  and  management  control,  these 
officers  gave  more  feedback,  both  positive  (rewards)  and  negative 
(disciplinary) . 

Coercion  appeared  to  be  effective  when  required  to  maintain  standards 
or  order  essential  for  mission  performance — for  example,  being  very  tough  on 
drug  abuse  on  nuclear  submarines,  as  illustrated  in  the  following  incident. 

(XO,  submarine):  "I  know  there  are  people  doing  drugs  on  board.  I 
tell  every  new  man  who  comes  on  board,  'Drugs  don't  go  down  on  this 
ship — and  if  you  mess  with  that  stuff,  I'll  catch  you  and  bust  you.' 

You  just  can't  have  that  kind  of  nonsense  on  a  nuclear  sub.  I  caught 
two  last  week  and  it  was  two  and  a  half  days  from  the  time  they  were 
caught  to  the  time  they  were  gone.  And  if  you  know  the  UCMJ  red  tape 
involved,  that's  fast." 
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Coercion  tended  to  be  ineffective  when  used  solely  to  maintain  a  super¬ 
ior's  power  position  or  to  demand  conformity  on  minor  issues  not  related  to 
mission  accomplishment  (characterized  by  respondents  as  "nit-picking"  or 
"harassing  people  about  Mickey  Mouse  stuff").  In  dealing  with  subordinates 
initial  problems,  errors,  or  infractions,  coercion  appeared  to  be  less 
effective  than  restraint  followed  by  counseling  or  coaching.  Superior 
officers  tended  to  coerce  subordinates  only  as  a  last  resort,  when  the  othe 
leadership  methods  proved  ineffective,  whereas  average  officers  were  more 
likely  to  use  coercion  as  a  first  or  only  resort.  This  distinction  was  il¬ 
lustrated  by  two  officers  interviewed  the  same  day  in  San  Diego.  Each  had 
received  seamen  who  had  been  in  considerable  trouble  in  their  former  units. 
The  first  officer  reported: 

"I  told  that  kid  that  I  didn't  care  about  his  past,  that  he  started  at 
day  one  with  me,  but  that  if  he  messed  up,  I'd  break  him  personally. 

I  got  on  him  about  his  appearance.  He  was  a  habitual  pig-pen.  One  day 
I  saw  him  holding  a  slack  line  on  a  capstan.  I  told  him  to  take  up  the 
slack.  He  just  stood  there.  I  said,  'All  right,  you've  had  it.'  I 
wrote  him  up  on  two  counts  of  insubordination  and  failing  to  obey  an 
order.  He  filed  a  complaint  against  me  charging  me  with  harassment. 
Then  he  went  UA.  Two  days  later  he  was  found  dead  in  a  bathtub  of  an 
overdose  of  drugs.  Maybe  I  helped  cause  it,  but  what  can  you  do  with 
someone  like  that?" 

The  second  officer  said: 

"I  get  transferred  a  lot  of  so-called  'deadheads,'  but  they  aren't 
really,  'cause  every  man  can  do  some  job  well,  and  I  can  prove  it. 

I  told  this  one  kid  I  didn't  care  about  his  past,  he  started  clean  here 
and  I'd  help  him  every  way  I  could.  I  gave  him  simple  jobs  I  knew  he 
could  succeed  at  to  give  him  some  wins.  I  tried  to  think  of  things  to 
do  to  build  his  self-confidence.  Everyone  else  had  a  tool  kit,  so  I 
gave  him  one.  Damn  if  he  didn't  break  down  and  cry.  He  said  no  one 
had  ever  trusted  him  enough  to  give  him  something  like  that  before. 

It  took  a  while,  but  he's  become  an  okay  mechanic  and  he's  not  been  in 
any  trouble  since  he's  been  here." 

The  first  officer,  rated  average,  expressed  negative  expectations  and 
used  coercion  resulting  in  an  undesirable  outcome.  The  second  officer, 
rated  exemplary,  expressed  positive  expectations,  and  used  a  coaching 
approach  which  effectively  empowered  his  subordinate  and  resulted  in  the 
latter  becoming  an  adequate  performer. 


Advising  and  Counseling 

A  somewhat  surprising  finding  was  that  Navy  leaders  spent  considerable 
time  acting  as  counselors,  advising  subordinates  on  performance,  discipli¬ 
nary,  career  planning,  and  personal  problems  such  as  drug,  alcohol,  finan¬ 
cial,  and  family  difficulties. 


Superior  officers  reported  incidents  in  which  they  identified  subordi¬ 
nate  problems,  initiated  contact  to  talk  about  these  problems,  or  were  per¬ 
ceived  as  approachable.  They  described  their  ability  to  hear  what  people 
were  trying  to  say  (accurate  empathy  or  insight  into  others'  needs,  motives, 
and  hidden  agendas),  and  acted  to  help  subordinates  with  personal  problems 
by  "fighting  for  their  people"  or  making  appropriate  referrals  to  other 
sources  of  help.  These  officers  also  made  significantly  more  statements  of 
belief  in  subordinates'  basic  worth  and  ability  to  perform,  and  more  use  of 
positive  expectations  to  inspire  improved  subordinate  performance. 

The  following  critical  incident  illustrates  this  factor. 

(BM2):  "I  had  this  one  seaman,  a  real  good  kid.  Suddenly  his  perform¬ 
ance  started  slipping.  I'd  see  him  wander  off  by  himself  during  breaks 
and  just  stare  out  to  sea.  I  went  up  to  him  and  said  'I  don't  want  to 
mess  with  your  private  life,  but  have  you  got  anything  you'd  like  to 
talk  about,  sort  of  get  off  your  chest?'  He  said  he  was  going  to  kill 
himself.  He'd  gotten  a  letter  from  his  wife  saying  she  was  leaving 
him,  living  with  some  other  guy.  1  talked  with  him  a  lot  after  that, 
over  the  next  few  months — mostly  just  listened.  He  got  divorced,  but 
he  didn't  do  himself  no  harm.  He's  okay  now.  He's  one  of  my  best  men." 

In  this  case,  the  petty  officer  noticed  his  subordinate's  distress,  made 
contact  in  an  understanding  way,  provided  counseling  assistance,  and  ex¬ 
pressed  consistent  positive  regard  for  the  individual  throughout  the 
process . 


Conceptual  Thinking 

Superior  officers  reported  more  incidents  in  which  they  identified, 
analyzed  and  solved  complex  managerial  problems.  Important  to  this 
"critical  thinking"  competency  was  the  ability  to  break  a  problem  down  into 
its  constituent  components,  and  cite  data  to  support  problem  analysis. 

The  following  incident  illustrates  this  competency. 

(CO,  destroyer):  "I  became  aware  of  four  things  I  thought  were  af¬ 
fecting  morale:  bad-mouthing  by  a  core  group  of  bad  apples,  lack  of 
unit  identity — due  in  part  to  too  much  overtime  work,  so  people  didn't 
see  their  families  on  weekends — and  infrequent  rewards  and  recogni¬ 
tion.  So  I  isolated  the  bad  apples,  went  to  a  4-day,  10-hour  week  so 
the  work  got  done,  but  guys  got  3  days  every  week  off,  and  organized  an 
on-ship  family  Fourth  of  July  party  where  I  gave  all  the  wives  and  kids 
planks  (emblems,  toys  symbolic  of  ship)  which  culminated  in  an  'awards 
ceremony'  where  I  praised  the  people  doing  a  good  job  in  front  of  their 
folks . . .etc ." 
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In  this  case  the  officer  identifies  the  overall  problem,  morale,  cites 
specific  factors  contributing  to  the  problem,  and  develops  corrective 
solutions . 

A  final  significant  finding  of  the  CNET  study  was  that  superior  officers 
had  a  wider  repertoire  of  leadership  competencies  than  did  average  officers. 
They  reported  use  of  more  and  different  leadership  competencies,  suggesting 
greater  flexibility  in  responding  to  situational  contingencies.  Superior 
leaders  differed  not  in  coercing  less,  but  in  coaching,  influencing, 
managing,  and  counseling  more. 


Design  of  Navy  Leadership  and  Management 
Education  and  Training  (LMET)  Programs 

I  will  conclude  by  briefly  describing  how  these  research  data  are  being 
used  in  the  design  of  competency-based  leadership  and  management  courses. 

Each  10-day  course  includes  three  parts.  The  first  part  of  the  course 
consists  of  intensive  modules  on  each  competency.  Each  module  includes  five 
elements : 

1.  Recognition.  Trainees  are  presented  with  a  difficult  case  or 
simulation  problem  designed  to  produce  a  "shock  of  recognition,"  in  which 
participants  realize  that  they  actually  encounter  problems  calling  for  use 
of  the  competency  in  question  in  their  real  jobs  and  that  they  often  have 
trouble  dealing  with  these  problems.  (For  example,  in  a  module  on  influ¬ 
ence,  trainees  may  be  asked  to  motivate  a  subordinate  who  panics  and  refuses 
to  perform  in  a  crisis.)  These  cases  and  simulations  are  drawn  from  actual 
critical  incidents  collected  during  the  research  phase  of  the  project.  The 
recognition  element  is  designed  to  introduce  the  topic  in  an  experiential 
way  and  create  specific  motivation  for  learning:  maximum  relevance  with  a 
recognition  of  actual  versus  desired  skill  in  the  competency. 

2.  Explanation.  Trainees  receive  practical  conceptual  input  on  the 
competency  via  readings,  lectures  or  demonstrations.  For  example,  in  a 
module  on  influence,  participants  would  get  a  lecture  on  the  importance  of 
power  motivation  in  leadership  tasks,  how  to  see  managerial  interactions  in 
terms  of  influence  skills,  then  a  videotape  demonstration  of  specific  ways 
of  dealing  with  the  situation  presented  in  the  "recognition"  case. 

3.  Self-assessment .  Trainees  receive  feedback  on  their  performance  in 
assessment  center  simulations  on  each  of  the  competency  factors  predicting 
superior  performance.  This  feedback,  which  in  effect  tells  them  "this  is 
how  the  superstars  in  your  billet  perform  on  these  dimensions,  and  this  is 
how  you  perform,"  provides  each  trainee  with  very  specific  directions  or 
goals  for  change.  Descriptions  of  what  superior  performers  actually  do  to 
get  their  results — and  the  implication  that  trainees  can  learn  skills — 
provides  a  potent  role  model  and  motivation  for  participation  in  the  course. 
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4.  Skill  Acquisition  and  Practice.  Trainees  practice  using  the  compe¬ 
tency  skills  they  have  been  taught.  For  example,  they  diacuss  additional 
influence  cases,  describing  how  they  would  handle  each,  then  actually 
practice  giving  charismatic  speeches,  persuading  subordinates  to  reenlist, 
dealing  authoritatively  with  crisis  situations,  and  the  like.  Videotape 
critiques  are  used  to  give  participants  specific  feedback  on  their  develop¬ 
ment  of  skills. 

5.  Job  Application.  Trainees  identify  situations  in  which  thqy  will 
use  the  competency  in  their  jobs  and  set  goals,  anticipate  obstacles,  and 
develop  action  plans  for  doing  so.  This  element  reinforces  the  relevance 
of  training,  translates  it  back  into  real  job  performance,  and  increases 
the  likelihood  that  skills  developed  in  training  will  in  fact  be  used  back 
on  the  job. 

The  second  part  of  the  course  consists  of  a  large  scale  job  application 
simulation. 

Because  it  is  recognized  that  jobs  rarely  require  the  use  of  a  single 
competency,  a  three-day  full-acale  simulation  was  designed  to  present  par¬ 
ticipants  with  complex  problems  requiring  the  simultaneous  use  of  many  of 
the  competencies.  For  example,  in  a  course  for  commanding  officers,  par¬ 
ticipants  are  required  to  take  over  a  command  facing  a  major  inspection 
where  the  previous  CO  has  been  relieved  for  cause.  They  first  must  deliver 
a  "command  policy  statement"  at  their  first  Captain's  Call  when  they  assume 
command  (an  influence  task).  They  then  must  plan  for  the  inspection,  a  task 
which  requires  negotiation  with  their  superior  officer  and  various  supply 
units  for  material  and  resources,  under  time  pressure  and  in  competition 
with  other  COs  who  need  the  same  limited  resources  (a  task  with  technical 
achievement,  influence,  and  management  control  elements).  As  they  manage 
their  subordinates'  preparation  for  the  inspection,  they  encounter  various 
obstacles:  a  major  equipment  casualty,  a  racial  incident  which  threatens  to 
embarrass  the  CMD  and  bring  work  to  a  halt,  and  the  breakdown  under  stress 
of  a  key  subordinate  who  goes  AWOL  on  an  alcoholic  binge  (problems  requiring 
the  use  of  achievement,  management,  influence,  and  counseling  competencies 
in  various  combinations).  Each  problem  is  realistic,  drawn  verbatim  from 
critical  incidents  of  actual  billet  incumbents. 

The  final  part  of  the  course  consists  of  goal  setting  and  evaluation. 
Trainees  are  assessed  on  the  competencies,  helped  to  integrate  material 
learned,  and  asked  to  set  goals  for  use  of  developed  competencies  when  they 
return  to  their  jobs.  Coal-setting  exercises  have  a  career  and  life  plan¬ 
ning  emphasis,  encouraging  ongoing  self-assessment  and  planning  for  personal 
development.  Post-tests  provide  data  for  evaluating  the  course. 

In  summary,  the  Navy's  competency-based  leadership  and  management  pro¬ 
gram  is  designed  to  teach  practical  leadership  skills  which  have  been  shown 
empirically  to  predict  competent  job  performance:  what  superior  leaders 
actually  do  in  their  real  jobs. 
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LTC  Walton  invited  me  to  this  conference  to  tell  you  about 
the  Training  Developer  Decision  Aid  (TDPA)  being  developed 
by  ARI  at  Ft  Bliss.  The  project  began  three  years  ago  in 
the  midst  of  changes  in  Army  training,  especially  those 
required  by  the  performance  objective  based  guidance  contained 
in  the  5  volume  TRADOC  Pamphlet  350-30.  School  trainers 
became  training  developers  with  emphasis  on  upgrading  training 
in  the  field  by  producing  more  effective  training  materials 
and  aids.  There  emerged  major  new  training  materials  such 

AS  TEC  AND  OTHER  SELF-PACED  MATERIALS.  ALL  OF  THESE  ADDITIONS 
WERE  COUNTERED  WITH  A  MAJOR  DELETION,  RESOURCES.  (SLIDE  P 

Recognizing  that  the  training  developer's  assets  were  largely 

SHORT-TERM  MILITARY  SUBJECT  MATTER  EXPERTS  RATHER  THAN 
EDUCATIONAL  TECHNOLOGISTS,  ARI  DEVELOPED  A  MODEL  OR  DECISION 
AID  TO  ASSIST  THF  TRAINING  DEVELOPER  BY  PROVIDING  EXPLICIT, 
DATA  BASED,  PROCEDURES  FOP  DECIDING  HOW,  WHAT,  AND  WHERE  TO 

train.  (SLIDE  2)  Our  goal  was  to  develop,  validate,  and 

IMPLEMENT  SUCH  A  MODEL.  BOTH  THE  Al R  DEFENSE  SCHOOL  AND  THE 

Missile  and  Munitions  School  at  Huntsville  are  assisting  us 

IN  VALIDATING  THE  MODEL.  Let's  LOOK  INSIDE  THE  MODEL  FOP  A 
MINUTE  AND  BREAK  IT  INTO  ITS  MAJOR  PARTS.  (SLIDE  3)  THE 
FIRST  PARTITION  OPERATES  ON  A  TASK  BY  TASK  BASIS  AND  UPON 
COMPLETION  DELIVERS  WHAT  ARE  COMMONLY  CALLED  TASK  TRAINING 
PRESCRIPTIONS,  THAT  IS,  RECOMMENDATIONS  CONCERNING  THE 
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TRAINING  media  and  methods  to  use  fop  a  given  set  of  tasks. 

There  are  operations  which  deal  with  sets  of  t*sks  and  these 
yield  training  options  which  list  which  tasks  to  train  in  the 
school  and  which  in  the  unit.  Finally,  there  are  procedures 

WHICH  PERMIT  THE  TRAINING  DEVELOPER  TO  RAMK  POTENTIAL  TRAINING 
METHODS  IN  TERMS  OF  COST.  To  DERIVE  A  TASK  TRAINING  PRESCRIPTION, 
THE  DEVELOPER  FIRST  IDENTIFIES  A  TRAINING  ALGORITHM  BASED  ON 
THE  VERB  IN  THE  TASK.  (SLIDE  4)  THE  ALGORITHM  IDENTIFIES 
THE  TYPE  OF  COGNITIVc  OR  MOTOR  PROCESS  REQUIRED.  FOR  EXAMPLE, 

THE  VERB  "REMOVE"  IMPLIES  A  MOTOR  CHAINING  TYPE  CF  OPERATION. 

Algorithm  identification  was  designated  as  the  first  step 

BECAUSE  IT  OFTEN  FLAGS  AN  INAPPROPRIATE  ''ERB  SUCH  AS  "PERFORM" 

OR  SOME  OTHER  VERB  WHICH  INDICATES  THAT  THE  TA^K  IS  NOT 
STATED  CORRECTLY.  THE  TRAINING  ALGORITHM  IDENTIFIED  WILL 
ALSO  BE  USED  TO  VALIDATE  THE  TRAINING  METHOD  TO  BE  SELECTED 
LATER.  THE  NEXT  STEP  IS  TO  ANALYZE  THE  TASK  STIMULUS  BY 
ANSWERING  QUESTIONS  CONCERNING  ITS  TYPE  AND  OTHER  CHARACTERISTICS. 

This  process  results  in  a  recommended  stimulus  medium. 

The  analyst  then  answers  a  stmilar  <*et  of  questions  concerning 

THE  RESPONSE  REQUIRED  OF  THE  TRAINEE  LEARNING  THE  TASK.  THE 
MODEL  USES  THIS  INFORMATION  TO  PRODUCE  A  RECOMMENDED  RESPONSE 

MEDIUM.  When  the  characteristics  of  THE  recommended  stimulus 

AND  RESPONSEMEDIA  ARE  MATCHED  WITH  THE  SET  OF  METHODS  AVAILABLE, 

A  METHOD  IS  OBTAINED.  A  VALIDITY  CHECK  IS  THEN  MADE  TO 
DETERMINE  IF  THE  RECOMMENDED  METHOD  IS  COMPATIBLE  WITH  THE 
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TRAINING  ALGORITHM,  If  NOT,  THE  TASK  VERB  IS  EXAMINED  TO  BE 
SURE  IT  REFERS  TO  A  SINGLE  TASK.  A  TRAINING  SETTING  RESULTS 
FROM  QUESTIONS  SUCH  AS  WHETHER  OR  NOT  THE  TASK  IS  A  TEAM  TASK, 
THE  NUMBER  OF  PEOPLE  IN  THE  TEAM,  AND  WHETHER  OR  NOT  THE  TASK 
INVOLVES  EQUIPMENT  MANIPULATION.  THE  TRAINING  PRESCRIPTION, 

THEN  GIVES  US  RECOMMENDATIONS  ON  UQJi  TO  TRAIN.  WHERE  TO  TRAIN 
(SLIDE  5)  IS  ADDRESSED  IN  THE  TRAINING  OPTION  ANALYSIS  AND  FOR 
THIS  TASK  THE  MODEL  IS  ORGANIZED  AROUND  CERTAIN  DESCRIPTIVE 
CHARACTERISTICS  SHOWN  HERE  AS  WELL  AS  A  PROCEDURE  TO  HELP 
THE  ANALYST  IDENTIFY  THE  TASKS  HAVING  THE  HIGHEST  PRIORITY 
FOR  INITIAL  TRAINING.  To  DEVELOP  A  PRIORITY  FUNCTION  CONCERNING 
WHAT  TO  TRAIN,  (SLIDE  6)  WE  IDENTIFIED  THESE  FACTORS  AS  MOST 
SIGNIFICANT.  WE  CHOSE  PAY  GRADE  RATHER  THAN  SQT  LEVEL  BECAUSE 
WE  DISCOVERED  THAT  SOME  TASKS  WERE  PERFORMED  BY  E2,  OTHERS  BY 
E3  OR  EA,  AND  WE  DIDN'T  WANT  TO  LOSE  THE  PREDICTIVE  POWER 
PROVIDED  BY  THIS  DISCRIMINATION.  FOR  IMPACT  ON  OPERATIONAL 
READINESS,  WE  REFERENCE  THE  APPROPRIATE  DOCUMENT  FOR  EACH  OF 

the  Army's  air  defense  systems  which  lists  the  operational 

READINESS  CONDITION  GIVEN  THAT  EACH  OF  THE  SYSTEM  ITEMS  IS 

inoperative.  The  data  to  complete  the  last  three  factors  are 

OBTAINED  FROM  VALIDATED  TASK  LISTS  AND  FROM  CODAP  LISTINGS 
AVAILABLE  FROM  THE  MILITARY  OCCUPATIONAL  DATA  BANK.  AT  MILPERCEN. 

For  each  of  the  factors  we  developed  scale  values  as  shown  in 
SLIDE  7  where  the  higher  numbers  represent  a  higher  priority 

INITIAL.  TRAINING,  We  THEN  DEVELOPED  A  FUNCTION  WHICH  COMBINED 


7-4 


THESE  FACTORS  IN  THE  EQUATION  SHOWN  IN  SLIDE  8.  APPLICATION 
OF  THE  EQUATION  RESULTS  IN  VALUES  FROM  2.4  TO  34  AND  THESE 
VALUES  WERE  PRIORITIZED  AS  SHOWN.  THE  SCALE  VALUFS  AND 
EQUATIONS  ARE  NOT  CHISELED  IN  STONE.  THEY  ARE  INTENDED  TO 
PROVIDE  THE  TRAINING  DEVELOPER  WITH  THE  DISCRIMINATING  POWER 
HE  NEEDS  FOR  HIS  DECISION  MAKING.  We  ARE  WORKING  CLOSELY  WITH 
THE  TRAINING  DEVELOPERS  AT  USAADS  AND  AT  USAMMCS  TO  CONDUCT 
SENSITIVITY  ANALYSES  TO  DISCOVER  THE  SCALE  VALUES  AND 
WEIGHTINGS  THAT  WORK  BEST.  A  FURTHER  CONSIDERATION  IN  DECIDING 
HOW  MANY  TASKS  TO  ASSIGN  TO  TRAINING  IN  UNITS  IS  A  DETERMINATION 
OF  JUST  HOW  MUCH  TIME  IS  AVAILABLE  FOR  SUCH  TRAINING.  (SLIDE  9) 
First,  learning  times  for  each  task  assigned  to  training  in 

UNITS  IS  SUMMED  TO  OBTAIN  A  TOTAL  LEARNING  TIME.  THE  TRAINING 
DEVELOPER  THEN  MAKES  A  SERIES  OF  ESTIMATES  WHICH  RESULT  IN  A 
CALCULATION  OF  THE  NUMBER  OF  UNIT  TRAINING  HOURS  AVAILABLE 
DURING  THE  SOLDIER'S  FIRST  AND  SECOND  YEARS  IN  THE  ARMY.  He 
CAN  THEN  COMPARE  THE  TOTAL  TIME  REQUIRED  FOR  THE  TASKS  ASSIGNED 
TO  UNITS  WITH  THE  NUMBER  OF  HOURS  AVAILABLE.  If  HE  HAS 
ASSIGNED  TOO  MANY  HOURS  TO  UNIT  TRAINING,  HF  SHOULD  RECONSIDER 

mis  option.  Finally,  the  model  provides  a  procedure  for 
RANKING  METHODS  ACCORDING  TO  COSTS.  (SLIDE  .10)  HERE  IS  AN 
EXAMPLE  BASED  ON  7  METHODS  IN  THE  ROWS  AND  7  COST  VARIABLES 
IN  THE  COLUMNS,  AVERAGE  RANKINGS  FOR  THE  7  VARIABLES  INDICATE 
A  RANK  ORDER  FOR  THE  7  METHODS.  SEPARATE  COST  INDICATORS  ARE 
OBTAINED  FOR  RESIDENT  TASKS  AND  TASKS  TRAINED  IN  UNITS.  THESE 


ARE  THEN  COMBINED  TO  OBTAIN  AN  OVERALL  TRAINING  OPTION  COST 
INDICATOR  WWICH  MAY  BE  USED  TO  ESTABLISH  A  RATIO  CF  ONE 
TRAINING  OPTION  COST  TO  ANOTHER.  We  HAVE  DEVELOPED  THE  MODEL 
FOR  COMPUTER  PROCESSING.  THE  COMPUTER  PROCESSING  VERSION  IS 
COMPATIBLE  WITH  ANY  STANDARD  COMPUTING  FACILITY.  ONCE  THE 
DESCRIPTIVE  AND  EVALUATIVE  DATA  ARE  PREPARED  FOR  AN  MOS,  THE 
DATA  BASE  IS  AVAILABLE  FOR  QUICK  ACCESS  WHENEVER  REVISED 
TRAINING  DECISIONS  ARE  REQUIRED.  SUCH  A  DATA  BASE  SHOULD  BE 
VERY  USEFUL  FOR  CONTINGENCY  PLANNING  SUCH  AS  HOW  TO  DEAL  WITH 
DECREMENTS  OR  INCREASES  IN  THE  TRAINING  BASE, 

The  TDDA  model  was  developed,  flowcharted,  and  programmed 

DURING  THE  FIRST  YEAR  OF  THE  EFFORT.  THE  SECOND  AND  THIRD 
YEAR  HAVE  CONCENTRATED  ON  WORKING  CLOSELY  WITH  (JSAADS  AND 
USAMMCS  TO  DETERMINE  EASE  OF  USE  AND  UTILITY  OF  THE  TDDA,  AND 
TO  DEVELOP  USER  INSTRUCTIONS  WHICH  WOULD  PERMIT  THE  ANALYST 
TO  LEARN  THE  MODEL  IN  A  SELF  STUDY  MODE.  THESE  TRYOUTS  HAVE 
RESULTED  IN  A  TDDA  DATA  BASE  FOP  THE  FOLLOWING  MOS.  (SLIDE  11). 
At  present,  the  TDDA  is  being  validated  on  PATRIOT  to  determine 

ITS  APPLICABILITY  TO  EMERGING  WEAPON  SYSTEMS. 

The  major  tasks  to  be  accomplished  on  TDDA  during  FY  80-82 
ARE  SHOWN  IN  SLIDE  12.  A  detailed  description  of  thfse  tasks 

MAY  BE  FOUND  IN  THE  ATTACHED  STATEMENT  OF  WORK.  WHILE  EACH 
SCHOOL  WILL  DIFFER  WITH  RESPECT  TO  ITS  PRESENT  COMPUTER 
FACILITIES,  THE  TDIS  PLANS  CALL  FOR  EACH  SCHOOL  TO  O.'TAIN  A 
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A  MIN  I -COMPUTER  SYSTEM  DURING  THE  EARLY  80' S.  THE  TDDA 
IS  BEING  DEVELOPED  TO  BE  COMPATIBLE  WITH  COMPUTER  HARDWARE 
OBTAINED  BY  THE  SCHOOLS  AS  PART  OF  TDIS.  THE  TDDA  PROGRAM 
HAS  BEEN  WRITTEN  IN  FORTRAN  FOR  USE  IN  THE  BATCH  MODE. 

Therefore,  it  is  likely  that  many  schools  could  begin  using 
the  TDDA  immediately  exploiting  its  ability  to  organize  MOS 
data  and  provide  an  audit  trait  for  newly  assigned  analysts. 
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MODEL  PARTITION 


PRIORITY  OF  TASKS  FOR  INCLUSION  IN  INITIAL  TRAINING  DETERMINED  BY  SCALING 
AND  COMBINING  THE  FOLLOWING  FACTORS: 


SCALLmUtS 


EACIQR 

TASKS  PERFORMED  BY 
E-2  or  E-3 
E-4 
E-5 

E-6  OR  HIGHER 

OPERATIONS  READINESS 
RED 
AMBER 
GREEN 

TIME  TO  APPLICATION  TRAINING  TIME 

4  WKS  OR  LESS 

5-8  WKS  2  DAYS  OR  MORE 

5-8  WKS  LESS  THAN  2  DAYS 

MORE  THAN  3  WKS 

PERCENT  MEMBERS 
70  AND  ABOVE 
40-69 
20-39 
0-19 

PERCENT  TIME 
75  AND  ABOVE 
50-74 
25-49 
01-24 


RATING 

2 

1 

0.5 

0 

5 

4 

2 

4 

3 
2 
1 

4 

3 
2 
1 

4 
3 

2  . 
1 
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FUNCTION  FOR  DETERMINING  PRIORITY  OF  TASKS  FOR  INCLUSION  IN  INITIAL  TRAINING: 
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AIR  DEFENSE  TRAINING  DEVELOPER  DECISION  AID: 


STATEMENT  OF  WORK 


1.  TITLE.  Air  Defense  Training  Developer  Decision  Aid:  Model  Extension 
and  Research  Requirements. 

2.  BACKGROUND. 

a.  Implementation  of  the  Instructional  System  Development  (ISD)  processes 
by  the  Training  and  Doctrine  Command  (TRADOC)  and  the  establishment  of  the 
Enlisted  Personnel  Management  System  and  the  Officer  Personnel  Management 
System  have  resulted  in  many  research  requirements  in  direct  support  of  these 
innovations.  One  ambitious  TRADOC  program  followed  the  decision  that  skill 
qualification  tests  (SQT)  would  replace  current  100%  paper  and  pencil  Military 
Occupational  Specialty  (MOS)  tests.  Such  a  program  will  also  assist  in  the, 
quest  for  valid  measures  of  effectiveness  because  such  measures  will  be 

used  not  only  to  evaluate  training  effectiveness  but  also  to  assess  each 
soldier's  qualifications  for  holding  his  present  MOS  and  his  eligibility 
for  promotion. 

b.  Many  research  projects  will  contribute  to  the  SQT  program. 

These  include  major  efforts  to  derive  valid  task  analyses  and  to  effect 
a  symbiotic  relationship  between  data  obtained  on  the  basis  of  the  job 
and  task  analyses  and  those  data  obtained  from  occupational  surveys 
which  specify  who  is  doing  what  for  what  periods  of  time.  Extremely 
relevant  to  this  pursuit  is  the  development  of  a  model  which  assists  the 
training  manager  in  organizing  and  weighing  this  information  to  decide 
the  most  critical  tasks  to  be  trained,  the  best  method  of  training,  and 
best  place  to  train.  Such  research  is  most  challenging  because  it 
demands  the  determination  not  only  of  what  the  training  manager  needs  to 
know  but  also  how  best  to  present  it  to  him. 

c.  The  Training  Developer  Decision  Aid  (TDDA)  is  a  model  designed  to 
assist  the  training  developer  in  decisions  concerning  what,  where,  and  how 
to  train.  The  model,  developed  during  the  first  year  of  a  three  year  effort 
is  a  composite  of  three  partitions  including  (a)  training  prescriptions, 

(b)  training  options,  and  (c)  a  set  of  costing  procedures  for  fiscal 
ranking  of  training  alternatives.  During  the  second  year,  the  model  was 
implemented  in  manual  and  computer  modes  with  instructional  handbooks  for 
each  mode.  The  model  has  been  tried  out  in  each  mode  separately  using 
training  developers  from  the  US  Army  Air  Defense  School  (USAADS)  at  Ft 
Bliss,  TX  and  the  US  Army  Missile  and  Munitions  Center  and  School  (USAMMCS) 
at  Redstone  Arsenal,  AL.  Evaluation  data  has  included  user  acceptance, 
user  problems  during  implementation,  time  and  cost  data,  and  internal 
consistency  checks.  Model  revisions  and  development  of  self-paced  training 
materials  for  computer  implementation  of  the  model  were  completed  based  on 
year  2  results.  During  the  third  year,  additional  revisions  of  the  model  and 
the  training  materials  occurred  based  on  (a)  survey  of  Army  computer  systems, 

(b)  computer  implementation  of  the  model  at  Ft  Bliss  and  Redstone  Arsenal, 

(c)  tests  of  the  training  materials,  (d)  inclusion  of  selected  interactive 
procedures,  (e)  sensitivity  analyses,  and  (f)  cost  effectiveness  analyses. 
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d.  A  number  of  decisions  were  made  during  the  development  of  the 

TDDA  model  which  directly  affected  the  model.  Among  these  were  the  decisions 
that  (a)  Training  Development  Specialists  (TDS's)  or  Subject  Matter  Experts 
(SME's)  would  exercise  the  model,  (b)  the  model  was  specific  to  machine 
ascendant  MOS's,  and  (c)  model  users  would  provide  the  task  lists  for  each  MOS. 
In  addition,  there  was  insufficient  empirical  evidence  regarding  the  relation¬ 
ship  between  individual  differences  and  learning  algorithms  to  incorporate 
an  additional,  planned  partition  to  the  model  to  deal  with  treatment  by 
aptitude  interactions.  Inherent  in  the  model  are  the  effects  of  many  other 
decisions  regarding  criticality,  task  selection  for  training,  relative 
costing,  and  many  other  outputs  which  were  evaluated  during  subsequent 
testing. 

e.  In  recent  years,  a  number  of  similar  models  have  been  developed. 

These  include  the  Navy  Training  Analysis  and  Evaluation  Group  (TAEG)  model, 

Rand  MODIA,  and  the  Air  Force  TRAMOD.  The  various  models  can  be  character¬ 
ized  with  respect  to  (a)  research  versus  training  developer  applications, 

(b)  user  background,  (c)  equipment  oriented  tasks,  (d)  validity  and  detail 
of  task  data,  (e)  operation  mode,  and  (f)  media-method  selection. 

f.  Certain  aspects  of  the  current  TDDA  model  are  analogous  to  the  Air 

Force  TRAMOD,  for  example,  in  that  the  task  lists  for  both  models  are 

equipment  oriented  and  are  provided  by  the  user.  The  two  models  have 

entirely  different  approaches,  however  to  user  qualifications,  media- 
method  selection,  and  mode  of  operation.  For  TRAMOD,  behavioral  specialists 
are  the  recommended  users.  The  method/media  selection  is  driven  by  training 
objective  and  taxonomic  description.  For  the  taxonomic  description,  the 
user  decides  for  each  task,  the  appropriate  psychomotor  and  cognitive  levels. 
TRAMOD  is  operated  through  a  computer  in  the  interactive  mode.  The  TDDA  is 
operated  in  a  mixed  mode  involving  manual,  batch,  and  interactive  modes  of 
operation.  Analysis  of  differences  in  input  requirements,  processing,  and 
model  sensitivity  among  various  models  permits  an  understanding  of  the 
idealized  model  and  development  of  increasingly  responsive  applied  models. 

g.  The  TDDA  was  designed  for  specific  application.  The  principal  test  of 
the  model  is  how  well  the  model  serves  the  TDS  as  a  decision  aid  in  determining 
how,  where,  and  what  to  train.  At  present,  the  model,  as  exercised  by 

SME's  at  selected  points  produces  training  prescriptions  and  training 
options  as  a  function  of  relative  cost  as  output.  The  output  and  procedures 
have  been  judged  as  acceptable  by  TDS's.  Acceptance  has  been  based  on  the 
ease  of  learning  to  exercise  the  model,  reductions  in  time  and  effort  for 
developing  course  prescriptions,  increased  awareness  of  the  decisions  inherent 
in  completed  course  prescriptions,  and  completed  course  prescriptions  which 
are  judged  as  reasonable  and  consistent  with  TDS  experience.  The  existence 
of  a  valid  decision  aid  for  training  has  resulted  in  additional  requirements 
in  the  areas  of  both  application  and  research.  The  model  is  currently  in  use 
at  USAADS  and  USAMMCS.  The  model  has  undergone  continuous  revision  as  a 
function  of  its  utilization  with  selected  air  defense  operator  and  electronic 
maintenance  MOS's.  The  need  exists  to  continue  the  analysis  of  user  data 
with  respect  to  possible  revisions  of  the  model  and  the  instruction  materials 
for  model  utilization. 


h.  The  model  is  to  be  tried  out  in  other  TRADOC  schools.  As  the  model 
is  exercised  using  task  data  from  MOS's  which  are  less  equipment  oriented 
than  air  defense  MOS's,  the  applicability  of  the  model  to  these  MOS’s  must 
be  examined  and  a  decision  must  be  made  regarding  the  use  of  an  unspecified 
number  of  separate  models  or  one  generalized  model. 

1.  The  weakest  link  in  the  current  model  is  its  dependence  on  existing 
task  data.  ARI  has  developed,  under  contract,  a  Task  Analytic  Process  Model 
(TAPM)  to  assist  in  the  analysis  of  electronic  maintenance  jobs  and  tasks  Into 
task  elements  and  supporting  skills  and  knowledge.  Since  both  the  TAPM  and 
the  TDDA  are  equipment  oriented,  it  may  be  possible  to  integrate  the  two 
models.  Nevertheless,  a  need  exists  to  analyze  the  task  data  requirements 
of  the  TDDA  and  to  investigate  and/or  to  develop  the  means  to  incorporate 
one  of  any  number  of  suitable  task  analysis  processes  into  the  TDDA. 

j.  An  important  area  of  analysis  for  training  decision  aids  exists  with 
respect  to  the  treatment  of  method/media  selection.  Although  TRAMOD,  and 
TDDA  require  different  levels  of  user  expertise  to  exercise  the  media/method 
selection  portion  of  the  model,  simulator  predominates  as  a  recommended 
choice  for  both  models.  Jorgensen  and  Hoffer  (in  press),  in  presenting  a 
very  detailed  method/media  selection  procedure,  express  concern  that  various 
method/media  selection  schemes  emphasize  simulator  as  output  rather  than 
identifying  specific  characteristics  to  be  incorporated  into  a  simulator.  A 
need  exists  to  identify  the  assumptions  underlying  existing  practical  solutions 
and  to  determine  their  effects  on  model  outcomes.  In  addition,  more  infor¬ 
mation  is  needed  concerning  (a)  task  verbs  and  functional  task  groupings 

and  their  relationship  to  training  algorithms,  (b)  identification  of  relation¬ 
ships  among  stimulus  characteristics  and  media  selection  and  response  acceptance 
methods  and  method  selection,  and  (c)  empirical  evidence  supporting  media  and 
method  effectiveness. 

k.  The  TDDA  was  designed  as  an  aid  in  deciding  what  to  train,  how,  where 
and  at  what  relative  cost.  Early  in  the  conceptual  stage  of  TDDA,  considera¬ 
tion  was  given  to  the  problem  of  whom  to  train  how.  The  decision  was  made 
that  there  was  insufficient  empirical  evidence  at  that  time  to  support  the 
inclusion  of  population  specific  instructional  strategies  into  the  model. 

While  the  ARI  Field  Unit-Ft  Bliss  is  sponsoring  in-house  and  contract  work 

on  a  program  related  to  the  Trait-Treatment  Interaction  research  area,  the 
modest  success  of  that  program  to  date  (Sullivan,  et  al,  1978)  and  the 
current  state-of-the-art  (Cronbach  and  Snow,  1977)  suggests  that  it  is 
premature  to  include  training  prescriptions  based  on  individual  difference 
in  an  applied  training  model.  Nevertheless,  the  need  exists  to  examine  the 
TDDA  with  respect  to  providing  training  options  specific  to  selected  trainee 
characteristics  and  to  investigate  the  relationship  between  Trait-Treatment 
Interaction  research  and  the  generalized  problem  of  media/method  selection. 

3.  TECHNICAL  OBJECTIVES.  The  goal  of  this  research  effort  is  to  provide 
the  Army  training  schools  with  a  computer  based  decision  aid  for  training 
developers.  Since  an  earlier  effort  has  resulted  in  a  Training  Developer 
Decision  Aid  (TDDA)  for  USAADS  and  USAMMCS,  the  overall  objectives  of  this 
effort  are  to  refine  the  existing  model  with  respect  to  its  current  appli¬ 
cations,  to  implement  the  model  in  other  Army  schools,  and  to  conduct 
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research  to  improve  the  data  base  for  the  model  and  to  expand  upon  model 
applications.  There  are  eight  technical  objectives  to  be  accomplished, 
as  follows: 

a.  Revisions  of  the  TDDA  model  and  user  instructions,  as  indicated, 
based  on  the  analysis  of  user  data. 

b.  Analysis  of  TODA  model  input,  process,  and  output  requirements 

for  model  utilization  at  Army  training  schools  other  than  USAADS  and  USAMMCS. 

c.  Emplacement  of  either  the  TDDA  or  related  models  throughout  Army 
training  schools  and  the  revisions  of  the  model/models  as  indicated  by  user 
data. 

d.  Investigation  of  task  analytical  processes  to  include  analysis  of 
relationships  among  mission/equipment  requirements,  individual  versus  crew 
performance,  initiation,  and  completion  cues,  verb  lists,  and  training 
algorithms. 

e.  Development  of  a  task  analytic  partition  for  existing  training  models. 

f.  Analysis  of  the  effects  of  existing  applied  media/method  selection 
procedures  on  model  outcomes. 

g.  Investigation  of  the  effects  and  interactions  of  task  verbs,  training 
algorithms,  stimulus  characteristics,  and  response  acceptance  mechanisms 

on  generalized  media/method  selection  outcomes  and  the  determination  of  the 
differential  effectiveness  among  media  and  methods. 

h.  Development  of  a  trainee  characteristic  training  prescription 
partition  for  the  TDDA. 

4.  SCOPE  OF  WORK. 

a.  To  accomplish  the  technical  objectives  specified  above,  the  research 
effort  is  organized  into  eight  tasks,  which  are  described  below.  The 
Contractor  shall  provide  the  necessary  qualified  personnel,  facilities, 
materials,  and  services  to  accomplish  these  tasks.  While  all  the  tasks  are 
interrelated  somewhat,  the  following  table  reflects  the  schedule  implementation. 


TABLE  1 
TASK  SCHEDULE 


TASKS 


YEARS 

2 
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t>.  lask  i:  I UUA  ana  user  instruction  Key isioms.  it  is  assumed  that 
the  TDDA  ~wi  11  be  in  place  at  USAADS  and  USAMMCS  at  the  start  of  the  proposed 
effort.  If  the  TDDA  is  not  in  general  use,  the  COR  shall  initiate  selected 
model  implementations  at  both  schools.  The  contractor  shall  monitor  existing 
user  data,  develop  and  administer  additional  user  collection  forms  to  include 
interviews  and  questionnaires,  evaluate  user  data,  and  after  coordination 
with  the  COR,  revise  the  model  and/or  user  instructions  and,  at  selected 
intervals,  incorporate  the  revisions  into  the  implemented  model.  Anticipated 
areas  of  concern  for  revision  include  advantages  and  disadvantages  "related 
to  the  interactive  mode  of  model  implementation,  task  data  preparation  time 
and  procedures,  processing  of  high  density  tasks  and  tasks  high  in  similarity, 
and  new  MOS  training  prescriptions  for  weapon  systems  at  various  stages  of 
development.  All  approved  revisions  will  become  a  part  of  the  model  evalu¬ 
ation  process.  Extensive  revision  proposals  shall  be  tried  out  before 
inclusion  into  the  implemented  model. 

c.  Task  2:  TDDA  Output  Dependencies  for  Equipment  Oriented  MOS's. 

The  TDDA  was  developed  as  a  decision  aid  in  training  prescriptions,  training 
options,  and  relative  costing  for  machine  ascendant  MOS's.  Equipment  and 
equipment  readiness  are  involved  throughout  the  process.  The  contractor 
shall  analyze  TDDA  model  input,  process,  and  output  requirements  to  determine 
model  suitability  for  MOS's  which  differ  with  regard  to  equipment  orientation. 
The  analysis  shall  include  examination  of  the  existing  task  verb  dictionary 
and  its  expansion  as  indicated.  SME's  representing  different  MOS's  will 
try  out  the  model.  The  contractor  shall  monitor  these  try-outs  and  make  the 
necessary  adjustments  to  the  model  and  the  user  instructions  for  subsequent 
implementation.  It  is  anticipated  that,  for  most  of  the  Career  Management 
Fields  (CMF's)  only  minor  adjustments  will  be  necessary.  If  there  are  a  few 
CMF's  for  which  the  model  is  not  applicable  and  if  those  CMF's  represent 
relative  small  number  of  trainees  or  relatively  few  courses,  then  later 
model  implementation  will  not  be  affected  by  them. 

d.  Task  3:  Generalized  Model  Implementation.  The  COR  shall  introduce 
the  revised  model  based  on  Task  2  to  the  TRADOC  schools  and  shall  arrange 
for  an  initial,  limited  tryout  of  the  model  at  the  participating  schools. 

The  limited  tryout  will  involve  only  one  or  two  MOS's  at  each  school.  The 
contractor  shall  implement  the  model  as  indicated,  provide  for  the  collection 
of  user  data,  and  monitor  the  user  data.  At  the  completion  of  the  tryouts, 
the  contractor  shall  evaluate  the  user  data  and  revise  the  model  accordingly 
by  the  end  of  the  contract  year.  After  model  revision,  the  model  user 
instructions  and  the  model  evaluation  process  shall  be  implemented  again 

at  the  same  schools.  During  this  time,  model  evaluations  shall  be  recorded. 
Model  revisions  based  on  these  evaluations  shall  be  introduced  at  periodic 
intervals. 

e.  Task  4:  Analysis  of  Task  Analytic  Processes  and  Requirements  for 
Inc! usionin  Training  Models'.  This  task  is  to  provide'  the  information  for 
a  TDDA  partition  with  the  job,  task,  task  element,  and  skills  and  knowledge 
analyses  necessary  for  model  implementation.  The  partition  would  be  computer 
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based  and  interactive.  Toward  this  end,  the  contractor  shall  conduct  a 
literature  review  of  existing  training  models  and  task  analytic  procedures. 

The  contractor  shall  analyze  the  most  promising  of  the  existing  models  and 
approaches  with  regard  to  their  appropriateness  for  inclusion  in  the  TDDA. 

The  above  analysis  shall  be  concerned  with  the  quality  of  existing  task 
data  and  shall  incorporate  appropriate  task  verification  procedures.  These 
procedures  should  include,  but  not  be  limited  to,  periodic  interview  checks 
with  job  Incumbents  and  validation  testing  of  derived,  requisite  skills  and 
knowledge.  Emphasis  for  a  task  analytic  partition  to  TDDA  will  be  on  air 
defense  machine  ascendant  MOS's.  Task  data  sources  such  as  Soldier  Manuals 
and  Technical  Manuals  vary  in  their  usefulness  according  to  the  equipment 
orientation  of  the  MOS.  Given  the  current  emphasis  of  this  task,  it  may  be 
possible  to  use  existing  Technical  Manuals  as  the  principal  data  source  for 
task  analyses.  However,  based  on  the  literature  review  and  subsequent  analyses, 
it  is  anticipated  that  one  approach  to  be  considered  seriously  is  to  use  mission 
statements  together  with  supporting  equipment  specifications  and  tactics  to 
drive  the  task  analyses  and  team  and  individual  performance  objectives. 

Whichever  approach  is  used,  subsequent  partitions  should  be  expanded  to  pro¬ 
vide  for  the  possible  generation  of  training  and  evaluation  plans  for  unit 
training  that  are  interrelated  to  resident  training,  post  AIT  resident 
package  field  training,  and  (mission/unit  driven)  Skill  Qualification  Testing 
prescriptions. 

f .  Task  5:  Development  and  Evaluation  of  a  TDDA  Task  Analysis  Partition. 
Based  on  the  literature  review  and  analyses  from  task  A,  the  contractor 
shall  develop  a  task  analysis  partition  which  is  compatible  with  existing 
partitions  of  the  model.  The  contractor,  with  COR  approval,  shall  complete 
any  required  adjustments  to  the  original  partitions  which  are  dictated  by 
specific  characteristics  of  the  task  analyses  partition.  Those  adjustments 
which  would  result  in  the  generation  of  unit  training  and  evaluation  plans 
and  appropriate  SQT  prescriptions  would  seem  highly  desirable.  The  contractor 
shall  initiate  a  limited  evaluation  of  the  revised  model  which  will  include 
the  task  analysis  partition  and  the  revised,  remaining  partitions.  SME's 
provided  by  the  USAADS,  Directorate  of  Training  Development  (DTD),  will 
exercise  the  model  for  two  MOS's.  One  MOS  will  be  from  a  fielded  weapon  system 
and  the  other,  potential  MOS  will  be  for  a  weapon  system  currently  under 
development.  The  contractor  shall  collect  and  evaluate  user  data.  The  COR 
and  the  contractor  shall  arrange  for  DTD  personnel  to  evaluate  model  outcomes 
according  to  specified  criteria.  Based  on  the  results  of  the  evaluation,  the 
contractor  shall  revise  the  model  with  the  task  analysis  partition. 

9 •  Task  6:  Analysis  of  Applied  Media/Method  Selection  Outcomes.  The 
contractor  shall  analyze  the  media/method  selection  procedures  employed  by 
existing  training  decision  models.  During  the  analysis  of  each  media/method 
procedure,  objective/evaluative  data  shall  be  collected  concerning  the 
extensiveness  of  the  media  and  method  choices,  the  amount  of  useful  detail 
in  the  descriptions  of  the  methods  and  media,  and  the  procedures  going 
from  tasks  to  media/method.  In  addition,  the  contractor  shall  exercise 
all  models  extensively  with  simulated  data  to  determine  the  number  of 
realistic  choices  and  the  likelihood  of  each  outcome. 
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h.  Task  7:  Investigation  of  Generalized  Media/Method  Procedures. 

This  task  is  based  on  the  assumption  that  existing' media/method  selection 
procedures  result  in  training  prescriptions  which  are  lacking  in  detail. 
Training  decision  aids  should  provide  the  developer  with  a  method  design 
capability  in  which  the  performance  objectives  for  tasks  and  task  groupings 
drive  method  and  simulator  design  in  detail.  In  support  of  the  development 
of  a  media/methods  design  process,  analytical  and  experimental  research 

is  needed  on  the  effects  of  task  verbs,  task  groupings,  training  algorithms, 
stimulus  characteristics,  and  response  acceptance  characteristics  on 
generalized  media/method  design  process  outcomes.  This  phase  of  the 
task  is  judged  as  very  important  and  is  seen  as  involving  an  extensive 
literature  review  and  a  series  of  analytical  tests  of  the  Interrelationships 
among  components  of  the  media/method  design  process.  Additional  research 
might  include  literature  summaries  and  laboratory  Investigations  on  the 
differential  effectiveness  among  media  and  methods  as  a  function  of 
specific  performance  categories.  It  is  assumed  that  the  above  will 
require  utilization  of  one  or  more  existing  taxonomies.  The  selection  of 
given  taxonomies  shall  be  accompanied  by  analyses  of  their  strengths  and 
limitations. 

i.  Task  8:  Development  of  a  Trainee  Characteristic  Training  Prescription 
Partition  for  the  TDDA. 

(1)  Subtask  1.  Review  of  the  Aptitude-Treatment-Interaction  literature 
and  the  results  of  a  related  ARI  Field  Unit-Ft  Bliss  program  on  trainee 
characteristics  and  training  strategies  shall  be  accomplished.  Based  on 

the  review,  a  limited  number  of  tasks  shall  be  identified  for  training 
and  the  training  materials  to  support  selected  population  specific 
instructional  strategies  shall  be  developed. 

(2)  Subtask  2.  A  sample  format  of  a  trainee  characteristic  training 
prescription  shall  be  developed.  The  formatting  shall  be  consistent 

with  the  results  of  the  previous  tasks.  A  limited  trainee  characteristics 
partition  shall  be  developed  and  tried  out  using  the  tasks  identified  in 
Subtask  1.  The  partition  shall  include  the  requirements  for  personnel 
profile  data  base. 

(3)  Subtask  3.  Laboratory  investigations  of  the  effectiveness  of 
the  training  materials  developed  in  Subtask  1  shall  be  conducted. 

Additional  investigations  of  the  effects  of  selected  instructional 
strategies  as  a  function  of  trainee  characteristics  will  be  conducted 
for  a  sample  of  tasks  as  a  test  of  subtask  2  partition  outcomes. 

5.  PERIOD  OF  PERFORMANCE.  The  period  of  performance  is  for  an  initial 
interval  of  twelve  (12)  months,  after  date  of  award,  to  include  the 
delivery  of  the  reports  and  documentation  specified  in  this  Statement  of 
Work.  The  government,  subject  to  availability  of  funds,  may  negotiate 
contract  extensions  for  two  (2)  additional  years  of  research  effort  on  a 
year-by-year  basis. 


6.  REPORTS  AND  DOCUMENTATION. 


a.  Monthly  Progress  Reports.  Five  (5)  copies  of  monthly  progress 
reports  shall  be  submitted  by  the  Contractor  to  the  Contracting  Officer’s 
Representative  (COR)  with  a  copy  to  the  Contracting  Officer  by  the  10th  of 
the  month,  following  the  month  being  reported  upon.  Each  progress  report 
shall  describe  the  activities  from  the  previous  month,  those  anticipated 
for  the  coming  month,  and  problems  encountered.  The  cost  statement  shall 
present  the  information  In  both  graph  and  tabular  form,  indicating  funds 
remaining,  in  addition  to  funds  expended  during  and  through  the  reported 
time  period. 

b.  Final  Technical  Report.  A  draft  final  technical  report  will  be 
delivered  by  the  Contractor  to  the  COR  eleven  (11)  months  after  date  of 
contract  award.  This  report  will  summarize  the  entire  year's  contract 
work.  Following  COR  review  and  appropriate  revision,  the  final  technical 
report  will  be  delivered  in  one  (1)  reproducible  (camera-ready  copy)  and 
eleven  (11)  copies  at  the  end  of  the  contract  year.  (See  para  6c  for 
detailed  guidance.) 


Report  Specifications. 


(1)  Each  Contractor's  technical  report  shall  be  a  formal  scientific 
report,  ready  to  be  published  as  an  ARI  Technical  Report.  The  final 
camera-ready  document,  after  COR  approval  of  the  draft  version,  shall 
be  single  spaced,  black  and  white,  in  a  conventional  typeface  suitable 
for  microform,  reproducible  on  8  x  10  1/2  inch  paper  with  1-inch  binding 
edge  and  3/4  inch  to  1-inch  margins. 


(2)  The  report  shall  contain:  (1)  DD  Form  1473,  completed  except 
for  blocks  2,  3,  10,  15,  16,  and  17;  (2)  a  Brief  or  Summary  stating 
succinctly  the  Requirement,  Procedure,  Findings,  and  Utilization  of 
Findings;  (3)  a  Table  of  Contents  and  List  of  Tables  and  Figures;  (4) 
text  written  in  accordance  with  customary  American  scientific  practice; 
(5)  numbered  footnotes  giving  complete  bibliographic  references  on  the 
page  the  references  are  first  cited.  References  shall  follow  standard 
psychological  practices;  a  list  of  references  may  also  be  included  at 
the  end  of  the  report. 


(3)  ARI  publication  style  follows  very  closely  the  standards 
agreed  upon  by  behavioral  scientists. 


(4)  Illustrations,  tables,  and  mathematical  formulas  shall  follow 
standard  scientific  format  and  be  of  professional  quality  and  suitable 
for  microform. 

7.  ADDITIONAL  INFORMATION. 

a.  It  is  estimated  that  approximately  three  (3)  professional  person 
years  will  be  required  for  the  first  year's  effort.  Total  program  effort 
is  estimated  at  nine  (9)  professional  person  years. 


b.  Due  to  the  extensive  amount  of  coordination  with  military  personnel 
at  Ft  Bliss,  the  Government  shall  provide  work  space  at  Ft  Bliss,  Texas, 
that  the  Government  considers  sufficient  for  up  to  three  contractor 
personnel.  The  Government  will  provide,  as  it  deems  appropriate,  essential 
office  furniture,  equipment,  and  supplies. 

c.  Reading  of  the  references  cited  in  this  statement  of  work  Is  not 
mandatory.  Copies  of  the  referenced  material  will  be  made  available  to  tho 
successful  bidder. 


REFERENCES 


Braby,  R.;  Henry,  J.M.;  Parrish,  W.F.,Jr.  and  Swope,  W.M.  A  Technique 
for  Choosing  Cost-Effective  Instructional  Delivery  Systems  TTAC6  Rep  No. 16) . 
Orlando,  Fla.:  Dept,  of  the  Navy,  Training  Analysis  and  Evaluation  Group, 

April  1975. 

Braby,  Richard;  Micheli,  Gene  S.;  Morris  Charles  L.,  Jr.  &  Okraskl,  Henry  C. 
Staff  Study  on  Cost  and  Training  Effectiveness  of  Proposed  Training  Systems 
iTAEG  Rep.  No.  1).  Orlando,  Fla.:  Dept  of  the  Navy,  Training  Analysis  and 
Evaluation  Group,  June  1972. 

Carpenter-Huff man,  P.;  Fiyisaki,  M.;  and  Pyles  R.  MODIA:  Volume  3.  Operators 
and  Design  of  the  User  Interface.  Report  No.  R-1702-AF  Contract  F49620-77-0023 
Rand  Corp,  Santa  Monica,  CA.  September  1977. 

Cronbach,  L.J.  and  Snow,  R.E.  Aptitudes  and  Instructional  Methods.  New 
York:  Irvington  Publishers,  1977. 

Czuchry,  A.J.,  Doyle,  K.M.,  Feuch,  J.T.,  Baran,  H.A.,  and  Dieterly,  D.L. 
Digital  Avionics  Information  System  (DAIS):  Training  Requirements  Analysis 
Moder  User  Guide.  AFHRL-TR-78-58(ll).  Wright-Patterson  AFB,  Ohio.  September 
1978. 

Frederickson,  E.W.  and  Freer,  D.R.  Basic  Electronics  Skills  and  Knowledge. 
Contract  DAHC19-78-C-0002.  Applied  Science  Associates,  Inc.  ,  Valencia, 

PA.  December  1978. 

Jorgensen,  C.C.  and  Hoffer,  P.L.  Early  Formulation  of  Training  Programs  for 
Cost  Effectiveness  Analysis.  ARI,  Alexandria,  VA.»  in  press. 

Pieper,  W.J.,  Guard,  N.R.,  Michael,  W.,  and  Kordek,  R.  Training  Developers 
Decision  Dialogue  for  Optimizing  Performance-Based  Training  in  Machine 
Ascendant  MOS.  Contract  DAHC19-76-C-0043.  Applied  Science  Associates, 

Inc.,  Valencia,  PA.  November  1978. 

Sullivan,  D.J.,  Casey,  R.J.,  and  Hebein,  J.M.  Acquisition  and  Retention  of 
Cognitive  Versus  Perceptually  Oriented  Training  Materials.  Contract  DAHC19- 
77-C-0040.  Canyon  Research  Group,  Inc.,  Westlake  Village,  CA.  October  1977. 


SUBJECT  MATTER  EXPERTS  (SHE)  TODAY 


O 


GO 

_ 1 

• 

Z 

<r 

UJ 

o 

-« 

•— * 

h~ 

5 

» > 

<c 

o 

_ i 

oZ 

oa 

o 

1 — ■ 

aa 

CL. 

<c 

Q_ 

oc 

h— 

ca 

o 

LU 

UJ 

1 — 

2: 

GO 

_ 1 

<C 

*— « 

aa 

•— * 

«=c 

t _ s 

_ 1 

> 

GO 

>- 

o 

s*c 

o 

CQ 

ca 

esc 

GO 

GO 

<c 

Q_ 

Q_ 

<C 

>- 

CSC 

a 

LD 

§  5 


UJ  GO 
I —  LU 

5  £ 


£  § 

_ i 

*=C  LU 
< — >  I —  GO 

rr:  «c  -j 
ce  ■  o 
CO  QC  O 
I —  d_  or 
w  o  u 

CSC  GO 
ZJZ  Q_ 

Q_  CtC 

V  <  Ui 

55  = 

qc 

I —  U0  O 
CO 

LU  O  O 

I —  CSC  | — 

<C  re 

o  i —  s: 

Q-  -s  GO 


«=L 

o 

r— 

GO 

GO 

h— 

QC 

L_) 

LU 

cc 

CQ 

►— » 

X 

_J 

o 

o 

X 

GO 

LU 

_ 1 

oa 

\ 

c^: 

LU 

z: 

LU 

2 

t= 

«£ 

o 

ca 

a. 

a_ 

GO 

Co 

Q_ 

» — * 

cc 

LU 
i — 

LO 

<c 

<c 

OC 

CO 

ZS: 

LQ 

, _ . 

LU 

«3T 

_ 1 

—1 

P  ■ 

*— » 

<c 

LU 

LU 

_ 1 

Q_ 

QC 

<c 

l - 

CQ 

GO 

LU 

> 

LU 

_l 

LU 

O 

2 

2 

QC 

h— 

CQ 

O 

QC 

ca 

rs: 

<_> 

_j 

LU 

O 

18-2 


Q£ 

LU 

U_ 

CO 


§ 


CO 

s 

«=c 

CO 

3= 

•r.— 

o 

o 

O  LlJ 


§ 


O'. 


cn 

LU 

LD 

<c 


<c 


<C  CD 
Q 


CO 

o 

H” 

or 

£ 

cc 

<c 

CO 

PAS1 

NOW 

LU 

1 — 
C/5 

—1 

«=£ 

CO 

s 

cc 

1 - 

5 

CO 

LU 

o 

1 1 1 

- 

. 

>- 

CO 

1— 

h— 

CD 

o 

z 

18-3 


a 


_ 


.  FUTURE 

YOU  FORCE  THE  ISSUE 


PHASING 


HOW  THE  SCHOOLS  SAY  THEY  WOULD  USE  TDIS 


P— 

~~~ 

LU 

cZ. 

LU 

y* 

s 

C3 

Le) 

o 

CD 

a 2 

U_ 

s 

OO 

LU 

IE 

31 

►— » 

oo 

oo 

CO 

—I 

r** 

g 

— J 

<£ 

H- 

>- 

O 

s 

CD 

y— 

£. 

i  « 

4  4 

rr^ 

4—4 

CD 

1— 

CD 

4—4 

O 

_1 

<c 

'SZ. 

1 - 

IE 

E 

<c 

<*3 

4—4 

CO 

CD 

f: 

«r"— 

►— « 

oo 

4 - -4 

LU 

o 

s? 

h— 

H— 4 

y— 

f— 

CD 

O 

§ 

> 

oo 

LU 

H— 

CD 

CD 

o 

LU 

CE 

CO 

Ml  — 

2c* 

CD 

> 

\ 

►— « 

E 

CD 

CD 

LU 

> 

£ 

£ 

CD 

OO 

*— «  *— «  LlJ  *— •  ►— «  1 1  I 

I —  H-  ~ >  H-  h—  CE  >— 

«=c  <r  ce  sr  =3  «a: 

Q  UJ  I —  LU  LU  GO  C3 

CE  E  LU  Q  G)  CO  CE 

a  2  i->  <  d 


^  cr  m  U3  n  co  o) 


oo 

LE 

_J 

O 

o 

CO 

sz 

OO 

31 

CD 

►— * 

CD 

»—* 

oo 

OO 

CO 

>- 

LU 

LE 

« 

•u: 

CD 

Z"! 

cO 

<t 

OO 

El 

3 

CD 

5S 

Q_ 

r— « 

1— 

= 

S 

N 

Q3 

O 

OO 

S 

o 

3 

OO 

5 

oo 

1 - 

LU 

CE 

CE 

CE 

ZJ 

LU 

O 

O 

O 

h- 

LE 

LE 

LE 

f— 

<C 

« 

LU 

LU 

LU 

<c 

CE 

CO 

CO 

OO 

Di 

13 

=3 

13 

13 

O 

i — 1 

CM 

N~\ 

cr 

«— t 

r—i 

« - 1 

H 

ld 

GO  . 
UJ  J— 
GO  GO 
Cd  llJ 

=3  H- 
O 

L_>  •> 

LD 
LD  -ZZ 


5  2 


CZ 
^  O 
O  U_ 

GO  GO 


X  5= 

*"Jj  ^ 
C3  — • 
3  =3 

«t  C3 
UJ 

zr  c2 
o 


GO 

- 1 

cZ 

JK" 

cs 

ZD 

o 

X 

D_ 

*— « 

1 — ■ 

UJ 

GO 

<_> 

GO 

CQ 

h— 

o 

G3 

GO 

<c 

~o 

Q_ 

GO 

u_ 

UJ 

<c 

CD 

1— 

o 

cr; 

oo 

CS 

HH 

>- 

>— « 

Q- 

p 

O 

o 

O 

GO 

z: 

o 

u_ 

LL_ 

Ll_ 

LU 

33 

oz 

_ 1 

1— 

LU 

_j 

<C 

LU 

UJ 

UJ 

UJ 

LU 

<C 

H 

<c 

> 

GO 

GO 

GO 

GO 

H- 

LU 

=3 

PQ 

LU 

=3 

=3 

=3 

ZD 

GO 

CD 

C2 

O 

S 

l n 

U3 

IX 

oo 

cn 

CD 

1 - 1 

CM 

rn 

H 

« - 1 

» — 1 

CM 

CM 

CM 

CM 

i 


S1N3WTI3  viva  siai 


cx :  2= 


QZ 

LU 

LU 

Qi 

CO 

a 

s 

c5 

CD 

LU 

LU 

ZD 

CX 

g 

Q_ 

C_) 

LU 

o 

LU 

3 

_j 

> 

►— < 

_ i 

ZO 

h— 

f— 

<c 

<r 

LU 

h— 

LlJ 

Oi 

a_ 

ZD 

CD 

LU 

LU 

_J 

»— < 

CO 

£ 

»— 

<c 

& 

w 

t— 

<z 

CD 

f— 

CD 

_J 

CO 

CD 

LU 

5T 

O 

CD 

1— 

Q_ 

LU 

LU 

ac 

< _ > 

►— « 

CO 

LU 

_J 

f— 

H- 

LU 

<£ 

CD 

CO 

1 — 

T*? 

h- 

ZD 

>- 

_ 1 

3 

PQ 

_ 1 

•— < 

*— i 

cx 

h“ 

CD 

J— 

hh 

h~ 

Q- 

LU 

> 

»-  « 

3 

CD 

<c 

Q_ 

=3 

s*i 

o 

LU 

ZD 

£ 

•— • 

LU 

ax 

DC 

h— 

2EL. 

CO 

CD 

CO 

CO 

Oi 

U_ 

Oi 

Q_ 

t— 

CO 

CO 

O 

s: 

LD 

QC 

Si 

Si 

sc 

SC 

sc 

SC 

sc 

Si 

SC 

SC 

Si 

DC 

S£ 

CO 

CO 

CO 

CO 

CO 

CO 

CO 

CO 

CO 

CO 

CO 

CO 

K-“ 

<£ 

<L 

*=c 

<c 

«a: 

<c 

<£ 

<c 

<c 

<c 

«=E 

CD 

u 

h— 

1— 

t— 

t— 

t— 

1 — 

t— 

t— 

1— 

H— 

l— 

V— 

CD 

LA 

LO 

oo 

od 

o 

H 

CSI 

NS 

ci* 

LTD 

CD 

oo 

H 

« - 1 

rH 

H 

t-H 

CN| 

CSI 

CSI 

CSI 

CD! 

CSI 

CSI 

CSI 

CSI 

LU  <£ 
<_>  •— « 
sx  ai 


<c 

LU 

CO 

CD 

1— 

CO 

y 

1U 

CO 

LU 

►— t 

< 

CD 

LU 

Q_ 

LU 

\ - 

ZD 

1— 

>-*• 

1— 

*— 4 

CO 

CD 

<C 

CO 

CO 

CO 

LU 

1— 

>- 

CO 

»— ( 

o 

CO 

Q 

CD 

CD 

CD 

CO 

U_j 

►— « 

=3 

HH 

LU 

2 

y* 

LU 

CX 

ZD 

G 

ox 

1— 

CX 

< 

►— « 

lu 

*-H 

S~* 

<c 

CD 

LU 

LU 

LU 

•— « 

ZD 

CD 

cc 

o_ 

o 

LU 

Qi 

CQ 

_ 1 

CD 

CO 

*— * 

LU 

t— < 

Q_ 

© 

2 

1 - 

yr 

1 — 

<c 

«c 

Ll_ 

•a; 

ZD 

<c 

2 

LU 

CO 

CO 

'  "l 

HH 

CD 

Ly 

1 - 

2 

LU 

2 

o 

LU 

<c 

OL 

CO 

Q 

1 — 

C_3 

CO 

1 — 

OX 

H* 

LU 

CL. 

Q_ 

Si 

SC 

SC 

Si 

Si 

Si 

Si 

Si 

SC 

SC 

Si 

SC 

Si 

Si 

CO 

CO 

CO 

CO 

CO 

CO 

CO 

CO 

CO 

CO 

CO 

CO 

CO 

CO 

< 

<c 

<c 

<c 

c 

«=C 

<c 

< 

<c 

<t 

<c 

<c 

<£ 

<c 

1 — 

1 — 

1 — 

1 — 

l— 

l — 

1— 

i— 

1— 

h- 

1 — 

1— 

h- 

r— 1 

CSI 

NS 

■=r 

LA 

LO 

fsl 

oo 

CD 

CD 

t— 1 

CSI 

NS 

XT 

r-H 

1 — 1 

«— 1 

H 

r-H 

RESEARCH  BY  USING  ANY  DATA  ELEMENT  TO  CROSS  REFERENCE  AND 
DISPLAY  ANY  OTHER  TASK  CONTAINING  A  LIKE  ELEMENT. 


18-11 


<C  oC 

>  3D 
UJ  CD 
i— <  3D 

qd  s: 


<C  CD 


CD 

1 - 

UJ 

CD 

>- 

CD 

~z 

CO 

- 

CD 

CD 

< 

<C 

c5 

g 

>- 

h— 

<c 

LU 

CD 

g* 

CD 

1— 1 

<c 

• — i 

<£ 

51 

UJ 

UJ 

1— 

CD 

_l 

CO 

3D 

CD 

"sr 

< 

TDD 

< 

CO 

3D 

CO 

<5 

CD 

JR*  ■ 

<C 

r— 

CD 

D_ 

CD 

1 — 

o 

LU 

^D 

CD 

2D 

CD 

CO 

CO 

zz 

CO 

1 — 

s 

LU 

£ 

_J 

«a; 

CO 

51 

"\ 

o 

o 

1 — 

t— H 

CO 

CD 

o 

c2 

*\ 

_ 1 

3D 

LU 

u_ 

UJ 

s: 

CD 

o 

CD 

CD 

1 — 

o 

CD 

UJ 

*— t 

CD 

CO 

LU 

__  ■ 

►— i 

rvi 

t— 

LU 

CD 

CO 

UJ 

«cD 

H  1 

t— * 

33 

CD 

*— * 

CD 

CD 

CD 

O 

O 

UJ 

51 

CD 

2D 

zz 

LU 

1— 

CO 

CL¬ 

<r 

. 

O 

►—1 

UJ 

3D 

s 

CO 

CD 

"T 

O 

CO 

QD 

CD 

f— 

UJ 

' 

CD 

Q_ 

«a: 

►— < 

«c 

>  -< 

LU 

CD 

O 

co 

CL 

UJ 

3: 

i — 

CD 

o 

«c 

QD 

<c 

51 

> 

CO 

«c 

UJ 

CL. 

t— 

• 

O 

CO 

CD 

CO 

C/3 

CD 

CO 

DC 

u_ 

zz. 

UJ 

3D 

>- 

UJ 

ZZ 

CO 

o 

D3 

CD 

-c_C 

1 — 

LU 

QD 

LU 

OD  CD 


DC  CD 
2:  CO 


CD  O 

<£  Li. 


CO 

UJ 

CD 

<c 

DC 
-  CD 
CO 

<C  —I 
UJ  < 
CD  ZZ 
<C  *— i > 


Q_ 

LU 

LU 

O 

a_ 

CO 

O 

LU 

3D 

3 

CD 

QD 

t-  — « 

51 

s 

LU 

t — i 

CD 

51 

CO 

zz 

H 

O 

< 

QD 

QD 

1— 

_J 

LU 

LU 

o 

CD 

CD 

3D 

l— 

CD 

<c 

3D 

<c 

DD) 

CD 

D*D 

t.— t 

y 

O 

CO 

LU 

~Z 

CO 

CD 

O 

<C 

3* 

LU 

CD 

% 

QD 

<c 

o 

< 

•— « 

CD 

o 

>- 

CD 

1 — 

LU 

ZcZ 

i 

H— 

<C 

CD 

1 — 

_J 

D«D 

_J 

y~ 

3D 

H; 

1— 

CO 

LU 

<c 

CD 

o 

CO 

— . .  — 

LU 

<C 

LU 

LU 

D  ‘ 

» — * 

o 

CO 

UJ 

gr— 

LU 

D*D 

O 

CD 

1— 

►— « 

zz 

3D 

3D 

UJ 

CD 

o 

T*»* 

CO 

t — i 

3 

t— 

o 

C 2 

CD 

CD 

z: 

CD 

CD 

<c 

_ 1 

CD 

— 

CO 

CD 

•  2 

Cl. 

. 

i— 

<C 

QD 

LU 

. 

•s 

<C 

h- 

O 

co 

> 

»— H 

LU 

LU 

CD 

o 

1 — 

LU 

CO 

CD 

Tr— 

QD 

_! 

LU 

DID 

1— 

CD 

#— < 

CD 

QD 

—1 

CO 

>- 

CD 

LU 

Q_ 

CD 

Q 

t-H 

CD 

LU 

t— t 

> 

O 

a. 

CD 

CD 

LU 

CO 

O 

QD 

QD 

CD 

> 

O 

QD 

LU 

QD 

QD 

LU 

LU 

de: 

y~ 

1 — 

<C 

O 

DD 

O 

LU 

• - * 

CD 

< 

LU 

QD 

~r 

CD 

CD 

LU 

LU 

O 

QD 

Q_ 

U_ 

LU 

CO 

<C 

— 

Q_ 

CU 

»— 

CO 

CD 

QD 

CO 

h- 

Cl. 

rH 

CXI 

hO 

cr 

lh 

UD 

rxl 

CO 

CD 

i — 1 

t-H 

t-H 

rH 

i — i 

' — 1 

rH 

1 — 1 

t — 1 

18-12 


TRADOC  WOULD  BE  RESPONSIBLE  FOR  COMMON  TASK  MANAGEMENT. 


PRESENT  TDIS  CONCEPT 


lu  z;  >-  «  <r 

l —  52  q  zc  cq  <c  s* 

o  lu  lu  i —  <_>  z: 

9=  t—  rvi  =d  cc  >-  >- 

zr  -h  CL  <  CL  >-  eq 

o  CL.  — i  s:  lu  o  PQ 

cd  cd  «=£•—<  co  cd  lu 

.  l—o 


co  <c 

CD  •— 


•—  LU 
CD  CD 


CeC  Q_  «=C 
<C  2=  3C 
2=  •— >  CD 


Q  3  UJ 

£  a  £  E  2 

1 — •  <  <c  o  Q 

SI  3=  3=  CD  ^ 

n  g  t  a  ~ 

.  ,  <C  o  LlJ  Q 

LU  3  W  | —  C£ 

CQ  CD 


<c 

oo  to 


=3  Q. 
I—  O 

CD 


>- 
—I I  <£ 
<C  5^ 


c_>  <— * 
or  X 
<C  or 

LlJ  o 
CO  3: 


►— 

h— 

=C 

1 — 

CD 

*— 4 

cf 

=3 

Q 

O 

o 

=3 

u_ 

on 

<c 

3C 

\ 

g 

1— 

”* 

o 

>- 

LU 

<_) 

\— 

b— 

LU 

* — t 

LU 

Qi 

_ 1 

—I 

U> 

LU 

CQ 

C3 

_J 

oa 

OQ 

CO 

•— • 

CO 

X 

LU 

C3 

LU 

C_> 

Q 

_ 1 

C_> 

<c 

Li_ 

<c 

m 

— 

18-15 


. 


ALL  ELECTRONIC  TRANSFER 


HumRRO  JOB  AIDS  FOR  USE  IN  IMPLEMENTATION  OF  THE 
INSTRUCTIONAL  SYSTEMS  DEVELOPMENT  (ISD) 
MODEL  (TRADOC  PAMPHLET  350-30) 


Presentation  given  by  Russel  E.  Schulz  at  the  Training  Developments  Institute  Soft 
Skill  Analysis  Seminar,  Holiday  Inn,  Newport  News,  Virginia,  16  August  1979. 
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WHAT  ARE  HumRRO  JOB  AWS? 


In  HumRRO  Project  IDA,  job  aids  are  being  developed  to  assist  instruc¬ 
tional  development  personnel  in  the  analysis,  design  and  development  of 
instructional  materials.  Project  IDA  is  being  conducted  for  the  U.S.  Army 
Research  Institute  for  the  Behavioral  and  Social  Sciences  and  the  Defense 
Advanced  Research  Projects  Agency  under  contract  DAHC19-78-C-0010.  The  Job 
Aids  being  developed  are  intended  to  be  stand-alone,  step-by-step  procedural 
guides  which  are  equally  useful  to  individuals  at  all  experience  levels  of 
the  instructional  systems  development  process. 

There  are  thirteen  HumRRO  Job  Aids  presently  available.  Each  Job  Aid 
is  comprised  of  two  documents,  each  of  which  is  described  below. 


Descriptive  Authoring  Flowcharts.  The  Descriptive  Authoring  Flowcharts 
are  the  primary  documents  used  in  the  HumRRO  Job  Aids.  They  direct  the  user 
to  specific  guidance,  examples  and  references  provided  in  the  Job  Aid  Manuals. 

Job  Aid  Manuals.  As  stated  above,  the  Job  Aid  Manuals  provide  the  specific, 
guidance,  examples  and  references  necessary  to  produce  the  product  for  the 
instructional  systems  development  activity  they  cover.  In  addition,  each  Job 
Aid  Manual  contains  one  or  more  Worksheets  to  use  in  the  development  of  the 
product. 


The  specific  HumRRO  Job  Aids  available  are:  (Flowchart  Manual  and  Job 
Aids  Manual  for  each)  These  correspond  to  the  ISD  Blocks  in  TRADOC  Pam¬ 
phlet  350-30. 


•  Job  Aid  for  Selecting  Tasks  for  Training 

•  Job  Aid  for  Conducting  Task  Analysis 

•  Job  Aid  for  Analyzing  Existing  Courses 

•  Job  Aid  for  Selecting  Instructional  Settings 

•  Job  Aid  for  Developing  Objectives 

•  Job  Aid  for  Developing  Tests 

•  Job  Aid  for  Describing  Entry  Behavior 

•  Job  Aid  for  Determining  Sequence  and  Structure 

•  Job  Aid  for  Specifying  Learning  Events  and  Activities 

•  Job  Aid  For  Specifying  Instructional  Management  Plan  and  Delivery  System 

•  Job  Aid  for  Review  and  Selection  of  Existing  Materials 

•  Job  Aid  for  Developing  Instruction 

•  Job  Aid  for  Validating  Instruction 


In  addition  to  the  printed  versions  of  the  above  Job  Aids,  programming 
design  guides  are  currently  being  developed  to  permit  the  Aids  to  be  avail¬ 
able  on  an  inquiry-type,  on-line  computer  version.  It  is  intended  that  the 
programming  design  guides  will  be  computer  system  independent. 

Today  I  will  describe  two  of  the  HumRRO  Job  Aids — ISD  Block  1.2  (Select 
Tasks/Functions)  and  ISD  Block  1.5  (Select  Instructional  Setting. 


UHAT  IS  THE  TASK  SELECTION  JOB  AIV  ALL  ABOUT? 

— The  purpose  of  this  aid  is  to  help  select  tasks  which  require  formal 
training,  i.e.,  critical  tasks. 

Critical  Tasks  =  Soldier's  Manuals  Tasks  =  Tasks  to  be  Trained. 

— It  is  not  efficient  in  terms  of  time,  personnel,  money  and  other 
resources  to  train  every  soldier  to  perform  every  task  of  his  MOS  in  every 
position  in  the  world.  This  block  requires  critical  and  non-critical  tasks 
be  identified.  This  job  aid  will  help  in  systematically  making  the  distinc¬ 
tion  between  tasks  which  require  formal  training  (critical)  and  those  which 
do  not  (non-critical) . 

— Some  of  the  reasons  a  task  may  not  be  selected  for  training  are: 

(1)  The  task  can  easily  be  performed  without  formal  training 
because  most  job  incumbents  have  previous  experience,  or  the 
task  is  easy  to  "pick-up"  from  daily  on-the-job  experience 
(OJE) .  Note  the  distinction  between  on-the-job  experience  and 
the  instructional  setting  called  supervised  on-the-job  training 
(SOJT) .  (For  a  description  of  SOJT,  see  HumRRO  Job  Aid  for 
ISD  1.5  Select  Instructional  Settings. 

(2)  The  task  may  be  part  of  the  job,  but  it  is  not  essential  to 
adequate  job  performance. 

(3)  The  task  may  be  quite  similar  to  other  tasks  which  require 
formal  training.  It  may  be  that  if  a  soldier  is  trained  to 

do  one  of  the  tasks  he  will  be  able  to  perform  the  other  simi¬ 
lar  tasks  without  further,  formal  training. 
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WHAT  ARE  THE  FOUR  MAJOR  STEPS  IN  SELECTING  TASKS  FOR  TRAINING? 
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-S-t.eP  T.  Each  candidate  task  is  rated  according  to  three  selection  criteria: 

smr  5  off  -r-sOTrm 

(1)  Time  to  train  by  on-the-job  experience  (OJE) 

(a)  Time  to  train  on  the  job  (on-the-job  experience,  not 
SOJT)  is  a  relative  measure  of  how  difficult  it  is  to 
perform  the  task.  Some  tasks  on  a  job  are  so  easy  to 
perform  they  require  no  formal  training.  Other  tasks 
are  so  complicated  that  the  soldier  can  perform  them 
adequately  only  after  lengthy,  formal  training.  Other 
tasks  lie  in-between  these  two  extremes.  In  rating 
each  task  on  this  criterion  it  is  necessary  to  consider 
how  difficult  it  would  be  for  a  soldier  to  learn  the 
task  on  his  own,  without  supervisor,  as  measured  by 
the  time  it  would  take  in  the  OJE  mode. 

(b)  Things  to  consider 

-  Amount  of  supervision  required 

-  Experience  of  the  soldier  at  previous  skill  levels 

-  Number  of  elements  which  make  up  the  task 

-  Type  of  task,  fixed  sequence,  alternate  path  or 
combination 

-  Amount  of  practice  required  to  attain  proficiency 

(c)  Sources  of  information 

-  Field  survey  of  job  supervisors  and  job  incumbents 
who  have  learned  or  taught  the  task  recently 

-  Panel  of  recent  job  supervisors  and  job  incumbents 

-  CODAP  data 

-  Own  judgement,  if  has  learned/ taught  task  recently 


Time  to 

train 

OJE 

is  estimated 
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the  following  scale: 
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(2)  Consequences  of  inadequate  performance 

(a)  This  is  a  relative  measure  of  the  seriousness  of 
incorrectly  performing  a  task.  It  is  a  relative 
measure  because  we  recommend  comparing  one  task  to 
all  the  other  tasks  in  the  MOS  being  analyzed.  (Not 
comparing  the  task  to  other  tasks  in  a  different  MOS. 
The  focus  is  on  both  mission  accomplishment  and  battle¬ 
field  survival.  While  the  tasks  of  a  clerk  typist 

may  not  have  a  directly  observable  impact  on  battle¬ 
field  survival  to  the  extent  that  an  infantry  rifle¬ 
man's  tasks  do,  they  certainly  impact  on  mission 
accomplishment.  Both  aspects  must  be  kept  in  mind. 
Frequency  of  performance  is  not  necessarily  related 
to  this  factor.  Tasks  which  are  performed  frequently 
may  not  have  extreme  negative  effects  if  they  are 
inadequately  performed,  while  tasks  performed  only 
rarely  may  have  disastrous  effects  if  not  done 
correctly. 

(b)  Things  to  consider 

-  Wasted  time,  inefficiency 

-  Destroyed  materials/equipment 

-  Loss  of  lives/injury 

(c)  Sources  of  information 

-  Field  survey  of  job  supervisors 

-  Panel  of  recent  job  supervisors 

-  CODAP  data 

-  Own  judgment 

(d)  Consequences  of  inadequate  performance  is  estimated 


using  the 

following  scale: 

Semi  -  Critical 

Disastious 

No  Effect 

Effect 

Effect 

i  2 

3  4  5 

6  7 

(3)  Probability  of  emergency  performance 

(a)  Probability  of  emergency  performance  is  estimated  by 
figuring  the  amount  of  time  the  soldier  has  between 
the  time  the  need  for  task  performance  becomes  evident 
and  the  actual  time  performance  must  begin.  There  are' 
some  tasks  for  which  there  can  be  no  delay  (a  true 
emergency) — instant  response  is  required.  For  other 
tasks  a  delay  of  a  few  minutes  might  be  quite  acceptable. 


or  even  mandatory,  while  the  soldier  gets  advice, 
checks  technical  manuals,  regulations,  etc.  And  for 
some  tasks  there  might  be  time  to  assemble  a  group  of 
experts  and/or  practice  the  task  before  proceeding. 

(b)  Things  to  consider 

-  The  effects  of  time  delays  on  the  intended  outcome 
of  the  task 

-  The  variety  of  situations  in  which  task  performance 
may  be  required 

(c)  Sources  of  information 

-  Field  survey  of  job  supervisors 

-  Panel  of  recent  job  incumbents 

-  CODAP  data 

-  Own  judgment 

(d)  Probability  of  emergency  performance  is  estimated 
using  the  following  scale: 

Enough  Time 

Enough  Time  to  Obtain  Information  Instant 

to  Practice  or  Assistance  Response 

Before  Doing  Before  Doing  Required 

• - •  -  •  ■■  • - •  •  ■  • 

1  2  3  4  S  6  7 


Step  2.  Tasks  with  high  selection  criteria  ratings  are  identified 

(1)  The  requirement  for  training  is  determined  by  first  con¬ 
sidering  each  selection  factor  (time  to  train  OJE,  etc.) 
separately  and  then  considering  the  three  factors  together. 

(2)  A  task  should  not  be  identified  as  requiring  training  on  the 
basis  of  a  single  factor  rating,  unless  that  rating  is 
extremely  high,  a  6  or  7. 

(3)  When  all  three  factors  are  considered  together,  the  rating 
should  be  12  or  more  in  order  to  identify  the  task  as 
requiring  training. 

(4)  These  criterial  values  may  be  adjusted  to  fit  your  particular 
situation.  The  important  thing  is  to  determine  the 

-  single  factor  criterion 

-  total  factor  (task  value)  criterion 

and  apply  these  values  throughout  the  MOS  you  are  working  in. 


Ste£_3.  Tasks  requiring  training  are  examined  for  similarity  of  per¬ 
formance  requirements 

(1)  If  the  performance  requirements  are  highly  similar  for  two 
.or  more  tasks  which  require  training,  it  should  not  be 
necessary-  to  train  each  task,  but  only  the  most  representa¬ 
tive  task  of  that  group,.  Therefore,  in  this  step  it  is 
determined  if  two  or  more  tasks  are  similar  due  to: 

-  equipment/materials  similarity 

-  performance  similarity 

(2)  Sources  of  information 

-  Task  summary  sheets  or  soldier rs  manual 

-  Tils  and  FMs 

-  TOEs  and  TDAs 

-  SMEs 

-  Own  judgment 
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SteP  4.  Administrative  review  of  tasks  recommended  for  training  takes  place 

(1)  In  this  step  an  alternate  panel  of  subject  matter  experts 
review  the  Critical  Task  Inventory  Sheet.  The  purpose  of 
having  an  alternate  (different)  group  of  SME's  review  the 
CTI  Sheet  is  to  provide  an  objective  view.  A  panel  of 
three  SME's  is  sufficient.  The  panel  should  be  asked  to 
verify  the  selection  factor  ratings  and  task  similarity 
judgments. 

(2)  CTI  Sheets  are  submitted  to  the  supervisor  for  review  and 
approval . 
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WHAT  ARE  THE  PROVUCTS  THAT  RESULT  FROM  THE  SELECT  TASKS/ FUNCTIONS  JOB  AJV? 

The  input  for  this  block  is  a  listing  of  all  the  tasks  which  are  performed 
in  a  particular  skill  level  of  an  MOS.  The  output,  or  products,  include: 

-  The  list  of  critical  tasks  for  which  formal  training  is  authorized. 

-  The  worksheets  on  which  the  task  selection  decisions  are  documented. 
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WHAT  IS  THE  INSTRUCTIONAL  SETT  JUGS  JOB  A1V  ALL  ABOUT? 


The  purpose  of  this  aid  is  to  help  choose  instructional  settings  (training 
locations)  for  tasks  selected  for  training  within  each  skill  level.  Due  to 
advancements  in  instructional  technology  it  is  often  more  cost-beneficial  and 
efficient  to  train  tasks  in  a  non-ins titutional  (extension)  setting.  This  aid 
is  designed  to  help  identify  as  many  tasks  as  possible  for  which  extension 
training  is  appropriate. 


WHAT  ARE  THE  THREE  INSTRUCTIONAL  SETTINGS? 

■ 


Institution  (INST) 

Supervised  On-The-Job 
Training  (SOJT) 

Self-Study 

Training  conducted  at  TRADOC 

Training  conducted  at  the 

Training  administered  during 

resident  schools  and  includes: 

OSUT  -  One  Station  Unit 
Training 

PNCOC  -  Primary  Noncom¬ 
missioned  Officer 
Course 

BNCOC  -  Basic  Noncom¬ 
missioned  Officer 
Course 

ANCOC  -  Advanced  Noncom¬ 
missioned  Officer 

soldier's  unit 

individuals  own  time,  usually 
at  the  soldier's  unit  and  includes: 
Self-teaching  exportable 
packages  (STEP) 

Training  Extension  Courses 

Job  Performance  Aids 

Study  Guides 

Correspondence  Courses 

Films,  tapes,  etc. 

Course 

Training  always  conducted  under 
supervision  of  qualified 
instructors 

Training  supervised  by  best 
qualified  NCOs  in  unit 

Little  supervision  required 

v 
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WHAT  ARE  ADVANTAGES  AND  DISADVANTAGES  OF  THREE  INSTRUCTIONAL  SETTINGS? 


Instructional  Setting 

Advantages 

Disadvantages 

INSTITUTION 

Usually  best  setting  for  training 
common  skill  level  tasks  or 
tasks  that  are  performed  by 
large  percentage  of  soldiers  in 
the  MOS/skill  level 

Sophisticated  training  resource 
and  expertise  available 

Lack  of  real  world  environment 

High  cost  of  soldier's  housing 
and  travel 

Time  is  spent  away  from  job 
assignment 

SUPERVISED 

ON-THE-JOB 

TRAINING 

Effective  for  training  tasks  that 
can  be  learned  faster  or  better 
with  hands-on  experience 

Soldier  contributes  to  unit's 
mission  while  learning 

May  tie  up  unit's  equipment  and 
thus  equipment  may  not  be  avail¬ 
able  for  operational  use 

May  overburden  supervisors 

Reduces  time  available  in  unit  for 
operational  requirements 

SELF-STUDY 

Effective  for  training  tasks 
which  can  be  learned  without 
an  instructor  or  where  little 
supervision  is  required 

If  study  occurs  during  normal 
duty  hours,  this  type  of  training 
may  reduce  time  available  in  unit 
for  operational  requirements 

Can  be  accomplished  at 
trainee's  convenience 

May  require  soldier  to  devote 
considerable  off-duty  time  to 
study 

12 
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WHAT  ARE  THE  FOUR  MAJOR  STEPS  IN  SELECTING  INSTRUCTIONAL  SETTING? 


Step  1.  Tasks  selected  for  training  are  listed  and  categorized  by  skill 
level  and  duty  position 

(1)  Sources  of  information  for  duty  position  designations 

(a)  Output  from  ISD  1.2  and  ISD  1.3 

(b)  AR  611  series  for  existing  jobs 

(c)  Individual  who  developed  the  job  identification 
for  new  MOS  only 

(d)  Soldiers  Manual 

(e)  TOE/MTOE/TDA's 


Step  2.  Task  performance  data  are  obtained  and  recorded  for  each  task. 
That  is : 

(1)  In  which  duty  positon  is  the  task  performed? 

(a)  Sources  of  information 

-  Output  from  ISD  1.2  and  ISD  1.3 

-  Field  Survey 

-  CODAP 

-  Panel  of  recent  incumbent 

-  Soldiers  Manual 

-  Panel  of  subject  matter  experts 

-  Own  judgment 

(2)  What  percentage  of  soldiers  perform  the  task? 

(a)  For  each  task  the  percent  of  soldiers  within  the 
skill  level  who  perform  the  task  is  identified. 

(b)  Sources  of  information 

-  Output  form  ISD  Block  1.2 

-  CODAP 

-  Field  Survey 

-  Panel  of  recent  job  incumbents 

-  Panel  of  subject  matter  experts 

-  Own  judgment 
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Initial  assignment  of  the  task  to  one  of  three  instructional 
settings  (institution,  supervised  on-the-job  training,  or  self- 
study)  is  made  based  on  the  answers  to  the  following  14  questions. 
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(1)  Is  task  a  common  skill  level  task?  (i.e. ,  Is  task  performed 
in  all  duty  positions?) 

(2)  Is  tusk  performed  by  n  high  percentage  of  soldiers?  (i.e., 
Should  task  be  classified  ns  a  high  performance  task?) 

(u)  The  criterion  for  High  Performance  Task  is  established 
for  ull  tasks  in  the  skill  level  before  asking  this 
question. 


[IF  THE  ANSWER  TO  QUESTION  1  OR  2  IS  YES,  QUESTION  3  AND  4 
ARE  ASKED.  IK  NO,  QUESTIONS  5  THROUGH  8  ARE  NEXT  ASKE1).] 


(3)  Is  task  performed  in  a  similar  manner  in  various  duty 
positons  and  units? 

(a)  Generally  a  task  classified  ns  either  a  common  skill 
level  task  or  a  high  percent  performing  task  will  be 
trained  in  the  resident  school  (institution)  setting. 

In  question  3  we  question  whether  task  training  require¬ 
ments  are  essentially  the  same  independent  of  the 
mission,  equipment  allocation,  geographical  location, 
etc.  ,  of  units  in  which  the  Job  incumbent  is  assigned. 

If  task  training  requirements  arc  pretty  much  the  same 
an  institution  training  setting  should  be  strongly 
considered.  On  the  other  hand,  if  training  requirements 
differ  considerably  between  units  or  duty  positions, 
training  the  unit  (SOJT  or  self-study)  should  be  con¬ 
sidered. 

(4)  Is  proficiency  in  task  performance  retained  over  time? 

(i.e.,  Not  easily  forgotten?) 

(n)  We  all  know  that  there  are  some  tasks  wo  remember  how 
to  do  more  easily  than  others.  Factors  which  influence 
retention  should  be  considered  when  selecting  the 
instructional  setting.  There  is  no  point  in  training 
a  task  in  the  institution  if  the  soldier  can't  remember 
how  to  perform  the  task  when  he  arrives  on  the  Job.  ; 
SOJT  or  self-study  should  be  considered  when  training 
retention  is  likely  to  bo  low. 

[IF  BOTH  QUESTION  3  AND  4  ARE  ANSWERED  "YES"  THE  TASK  IS  TNITIAIJ.Y 
ASSIGNED  TO  THE  INSTITUTIONAL  INSTRUCTIONAL  SETTING.  IF" EITHER  fs 
GIVEN  A  "NO"  ANSWER  QUESTIONS  5  THROUGH  8  ARE  ASKED] 
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(5)  Is  there  a  considerable  amount  of  theory  to  be  taught 
with  this  task? 

(6)  Must  this  task  be  performed  immediately  on  entry  to  the  job? 
(i.e..  Before  it  could  be  trained  on  the  job) 

(7)  Is  this  task  a  prerequisite  for  learning  and/or  performing 
other  school  trained  tasks?  (i.e..  Must  the  soldier  be  able 
to  perform  this  task  in  order  to  learn  other  tasks  taught  in 
the  school?) 

(8)  Are  equipment  and/or  facilities  only  available  for  training 
at  the  school? 

[IF  1  OR  MORE  "YES"  RESPONSES  WERE  GIVEN  TO  QUESTION  5  THROUGH  8 
THE  TASK  IS  INITIALLY  ASSIGNED  TO  INSTITUTIONAL  INSTRUCTIONAL 
SETTING.  IF  ALL  "NO"  RESPONSES  WERE  GIVEN  QUESTION  9  THROUGH  11 
ARE  ASKED.] 

(9)  Is  the  equipment  required  for  individual  training  of  this 
task  in  the  unit  available  at  most  units? 

(10)  Are  personnel  with  the  necessary  expertise  available  at 
most  units  to  conduct  the  training  for  this  task? 

(11)  Do  operational  requirements  at  most  units  allow  sufficient 
time  for  the  soldier  to  be  trained  in  trie  unit? 

[IF  ALL  QUESTIONS  (9-11)  ARE  ANSWERED  "YES"  THE  TASK  IS  INITIALLY 
ASSIGNED  TO  SOJT  INSTRUCTIONAL  SETTING.  IF  "NO"  QUESTIONS  12 
THROUGH  14  ARE  ASKED.] 

I 

(12)  Can  this  task  be  learned  with  very  little  supervision?  (i.e. 
Can  the  soldier  learn  the  task  through  self-study?) 

(13)  Does  the  soldier's  schedule  allow  sufficient  time  for 
independent  study? 

(14)  Can  everything  required  for  training  (which  is  not  already 
available  in  the  field  be  included  in  the  training  package 
and  is  it  inexpensively  exportable? 

[IF  ALL  QUESTIONS  12-14)  ARE  ANSWERED  "YES"  THE  TASK  IS  INITIALLY 
ASSIGNED  TO  SELF-STUDY  INSTRUCTIONAL  SETTING.  IF  "NO"  QUESTIONS 
9  THROUGH  14  ARE  RE-EVALUATED  TO  DETERMINE  IF  INSTRUCTIONAL 
SETTING  CAN  BE  DETERMINED  WITHOUT  SUPERVISORY  HELP.] 


Step  4.  Administrative  review  and  final  selection  of  instructional  setting. 

(1)  In  Step  3,  tasks  were  assigned  initially  to  one  of  the  three 
instructional  settings.  In  tills  step  each  task  is  reviewed 
to  determine  if  the  initial  assignment  is  still  the  best 
instructional  setting  on  the  basis  of  expert  opinion. 

(2)  After  reviewing  each  task  and  asking  questions  similar  to 
those  previously  asked,  any  indicated  changes  in  instruc¬ 
tional  setting  is  made.  The  rationale  for  each  change  is 
to  be  carefully  documented. 

(3)  The  task  listing  with  the  final  selections  of  instructional 

settings  is  submitted  to  the  supervisor  for  review  and  * 

approval. 

CTrT9w;  slide  2o~m  .  . 


WHAT  IS  THE  PROPUCT  THAT  RESULTS  FROM  THE  SELECT  INSTRUCTIONAL  SETTING 
J OB  AID? 

-  This  job  aid  will  result  in  a  listing  of  all  critical  tasks  in  which 
each  task  is  assigned  for  training  to  one  of  the  following  instruc¬ 
tional  settings: 

a.  Institution  (Resident  school  training) 

b.  Supervised  On-the-Job  Training  (SOU’) 

c.  Self-study 

-  This  output  will  be  especially  useful  in  the  preparation  of  the 
Commander's  Manual. 


SntOOTF 
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FOUR  MAJOR  STEPS  IN  SELECTING 


FOUR  MAJOR  STEPS  IN  SELECTING 


FOUR  MAJOR  STEPS  IN  SELECTING 

INSTRUCTIONAL  SETTING: 


quipment/Facilities  Unique  to  School?  14)  Lessons/Equipment  Exportable? 


FOUR  MAJOR  STEPS  IN  SELECTING 


questions. 

Step  4.  Administrative  review  and  final  selection  of  instructional 
setting. 


Graphic  Aids  Service  Center 

FORT  MONROE,  VIRGINIA 
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Graphic  Aids  Service  Center 

FORT  MONROE,  VIRGINIA 


GRAPHIC 


MONROE,  VIRGINIA 


ENLISTED  m\m  STRATEGY 


-  MAJOR  ISSUE:  NCO  LEADERSHIP  FOR  ARMY  OF  80' S 

~  DEV  COMPREHENSIVE  TNG  STRATEGIES  WHICH  BEST  MEET  NEEDS 
OF  UNIT. 

—  COMPLETE  REQUIRED  COURSES  TO  SUPPORT  NCOES. 

—  FORMALIZE  NCOES  (e.g.,  REGULATORY  PROCEDURES  WHICH  INSURE 
NCO  RECEIVE  NtCESSARY  TNG  FOR  JOBS. TO  WHICH  ASSIGNED. 

(AR  351-1) 

m 

—  ESTABLISH  REGULATORY  PROCEDURES  WHICH  FORMALIZE  LINK 
BETWEEN  INDIVIDUAL  &  COLLECTIVE  TRAINING  IN  UNITS,  AND 
THE  ROLE  OF  NC(rAS  TRAINERS  IN  UNITS  (AR  350-1). 

-  FOCUS  TODAY  IS  ON  ENlISTED  TRAINING  STRATEGIES 


.  .41  .'4/4 


•*  **•  4. » 4  j j.'/.  1  j.»  .v  *■  V  . .  i  »•  1 ,  w... 


GUIDANCE  FOR  ANALYSIS 


RESULTS  OCCUR  ONLY  IN  OPERATING  UNITS  OF  ARATY  ,  ACTIVE  AND  RC. 

RESULTS  ARE  THE  INTERACTIVE  EFFECT  OF:  • 

A.  IET  •  •  .  '  • 

B .  NCOES  •  . ■  •./  ' 

C.  TRAINING  SUPPORT  .  .  • 

THUS  ,  YOU  MUST  WEIGH  TRADEOFFS  AMONG  THESE  TO  DETERMINE  MOST  COST 
EFFECTIVE  WITHIN  GIVEN  (  OR  ASSUMED  )  RESOURCE  LEVELS 

DO  NOT  LOSE  SlGHT  OF  NEED  FOR  "  ATCB1LI2ATION  "  TRAINING,  BUT  BEAR  IN 
MIND  PROBABLE  HIGHER  "PAYOFFS'’  FROM  APPLICATION- OR  ANY  INCREATENTAL 
RESOURCE  INCREASE  TO  NCOES  RATHER  THAN  I  FT  .  ' 

•  •  i 

*  (  4  .  \  N  '  «•  • 

■  I  !.»«-— !■» I1 1  — ■  «  'T  —  . . .  I  ,  I". — 

IM.1  i.m.  »  XI  ■'  - - A-v  ril  n  ■  .... - 


-  CG  LTR,  1  MAY  79,  PROVIDES  THIS  FRAMEWORK  FOR  SCHOOLS  EFFORT. 

-  THE  TRAINED  NCO  SETS  THE  UPPER  LIMITS,  WITHIN  UNITS,  FOR  BOTH 

—  INITIAL  ENTRY  SOLDIERS 

4 

—  TNG  SPT  PRODUCTS 

-  INITIAL  ENTRY  SOLDIER  AND  TNG  SPT  MAY  BE  MARGINAL-WITH  OUT¬ 
STANDING  NCO,  WE  COULD  GET  THE  JOB  DONE. 


HOWEVER,  IF  NCO  ARE  MARGINAL,  WE  COURT  DISASTER. 


THREE  PART  ANALYSIS 


1.  WITHIN  PRESENTLY  AVAILABLE  RESOURCES,  DETERMINE  BEST  BALANCE  AMONG 

••  IET,  NCOES,  AND  TRAINING  SUPPORT .  (  IF  TRADEOFFS  WILL  NOT  ENHANCE  UNIT 
PROFICIENCY,  EXPLAIN  WHY) 

« 

2.  DETERMINE  RESOURCES  REQUIRED  TO  ASSURE  UNIT’ ABILITY  TO  ACHIEVE  ARTEP  / 

■  SM  STANDARDS,  GIVEN  CURRENT  CMF  STRUCTURE  •  ■  ' 

3.  ASSESS  EXTENT  TO  WHICH  CMF  RESTRUCTURING  WOULD  NARROW  GAP  BETWEEN 
CAPABILITIES  (1)  AND  REQUIREMENTS (2). .  GIVE  RATIONALE  FOR  CHANCES  AND 

’  RESOURCE  IMPLICATIONS 


CG  LTR  SPECIFIED  GUIDANCE: 

—  USE  JUDGMENT  AND  COMMON  SENSE 


—  SOLUTIONS  BASED  ON  TOTAL  UNDERSTANDING  OF  THE  UNITS  FOR 


WHICH  SCHOOLS  HAVE  PROPONENCY. 

•  # 

—  DEVELOP  THREE  STRATEGIES-- ESTABLISH  MILESTONES 
—  CURRENT  STRUCTURE  &  TRAINING 
—  PROPOSED  REQUIREMENTS  -  ETS  -  UNCONSTRAINED. 
—  BEST  CASE—  ETS— W/ "TRADEOFFS" 
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STATUS  REPORT 


•  CA  MOS  STRATEGIES  VIABLE  AND  IN  PLACE  EXCEPT  FOR  ANCOC 

--  ANCOC  UNDER  REVISION 

•  CSS  MOS  PICTURE  VERY  UNEVEN 

—  FEW  COMPLETE  MOS  STRATEGIES 
—  FEWER  COURSES 

—  SEVERE  ATTENDANCE  SHORTFALL  AT  PTC/BTC 
—  CRITICAL  NEED  TO  TRAIN  SUPERVISORS  IN  THE  MAINTENANCE 
FIELDS 

•  SYSTEM  PROBLEMS 

--  TRAINING  NEITHER  LINKED  TO  PROMOTION  NOR  INFLUENCED 
BY  ASSIGNMENT 

—  SOLDIERS  WHO  NEED  THE  TRAINING  ARE  NOT  NECESSARILY 
TRAINED 


-  TD  EFFORT  IN  EARLY  STAGES: 

—  MUST  APPLY  TRADOC  POLICY  FOR  DEVELOPMENT  OF  ENLISTED  TNG 
(TRADOC  CIR  351-10) 

—  MUST  APPLY  RESULTS  OF  CURRENT  ETS  EFFORT 
--  "SYSTEMS  PROBLEMS1'  POSE  GREATER  CONCERN— THEY  REPRESENT  A 
CONTINUOUS  DRAG  ON  UNIT  READINESS  (SEE  FOLLOWING  VU-GRAPH) 

—  (E.G.,  SKILLS  NOT  APPLIED  TO  JCBS  FOR  WHICH  DETERMINED 
(VIA  JOB/TASK  ANALYSIS)  NECESSARY) 

-  THERE  IS  AN  ARMY  NEED  TO  FORMALIZE  NCOES 


RESULTS 


•  TOO  FEW  KEY  LEADER/SUPERVISOR  POSITIONS  OCCUPIED  BY  GRADUATES  OF 


NCOES  COURSES 


•  TOO  FEW  NCO  TRAINERS 


•  TRAINING  NOT  DECENTRALIZED 


•  TRAINING  NOT  INDIVIDUALIZED 


•  WITHOUT  TRAINED  SUPERVISORS,  JOB  PROFICIENCY  OF  SKILL  LEVEL  I 
(E1-E4)  SOLDIERS  NOT  MAINTAINED 

•  LOW  SQT  SCORES  FOR  NCO 


•  LOW  SQT  SCORES  FOR  SOLDIERS 


•  LACK  OF  INDIVIDUAL  JOB  PROFICIENCY  UNDERMINES  UNIT  READINESS 


SELF-EXPLANATORY 


POLICY  DIRECTION  TO  FORMALIZE  NCOES 


•  PROMOTION  BASED  ON  PERFORMANCE  AND  CDR'S  RECOMMENDATION;  SQT  SCORE 
OF  80  TO  BE  RETAINED  AS  A  STATED  OBJECTIVE 

•  FORMAL  TRAINING,  WHENEVER  NECESSARY,  FOLLOWS  SELECTION  FOR  PROMOTION 
AND  PRECEDES  JOB  USE  AT 'NEXT  HIGHER  SKILL  LEVEL 

•  NCOES  ON  TDY  AND  RETURN  BASIS,  SO  LOSING  CDR  IS  BENEFITING  CDR 

•  FORMAL  COURSES  NOT  LOCALLY  AVAILABLE  (PTC,  BTC,  ANCOC,  SNCOC) 
CENTRALLY  DIRECTED  BY  DA  (SCHEDULED  WITHIN  ONE  YEAR) 

•  NCOA-ADMINISTERED  COURSES  (PLC,  PNCOC,  BNCOC)  CONTINUE  WITH 
DECENTRALIZED  SELECTION,  BUT  UNDER  SPECIFIC  POLICY  ESTABLISHED 
BY  DA 


VU-GRAPH  SHOWS  KEY  POINTS  OF  CH  5  (NCOES)  REVISION-NOW  IN  DA/MACOM 
STAFFING 

NCOES/EPMS 


NOW  (CH  5,  AR  351-1) 

•  PROMOTION  ELIGIBILITY  TIED 
TO  TWO  GATES  (AR  614-200)  • 


1.  NCOES  COURSE  COMPLETION/OJE  WAIVER 

2.  SQT  QUAL  SCORE  (80)/SQT  WAIVER 

•  FIELD  CDR  NOT  PRINCIPAL  USER  OF  TRAINED 
NCO  ASSIGNED  TO  HIS  UNIT— TNG  TARGETED 
ON  JOB  3-4  YEARS  AHEAD 

•  PROMOTION  TO  E4  (LOCAL)  AND  TO  E5-E6 

(SEMI-CENTRALIZED)  HEAVILY  INFLUENCED 
BY  SQT  (ISO  PTS) _ 


AS  REVISED  (CH  5,  AR  351-1) 

PROMOTION  ELIGIBILITY  BASED 
ON  PERFORMANCE  (EER/CDR 
RECOMMENDATION) 


FIELD  CDR  PRINCIPAL  USER  OF 
TRAINED  NCO  ASSIGNED  TO  HIS 
UNIT— TNG  TIED  TO  ASSIGNMENT 


NO  CHANGE 


O 


K  ■  . 
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POLICY  DIRECTION  TO  FORMALIZE  NCOES 


PROMOTION  BASED  ON  PERFORMANCE  ANO  CDR'S  RECOMMENDATION 
or  BO  TO  BE  RETAINED  AS  A  STATED  OBJECTIVE 


SQT  SCORE 


FORMAL  TRAINING,  V/IIENLVER  NECESSARY,  FOLLOWS  SELECTION  FOR  PROMOl  ION 
AND  PRECEDES  JOB  USE  AT  NEXT  HIGHER  SKILL  LEVEL 


•  NCOCS  ON  TDY  AND  RETURN  BASIS,  SO  LOSING  CDR  IS  BENEFITING  CDR 

•  FORMAL  COURSES  NOT  LOCALLY  AVAILABLE  (PTC,  BTC,  ANCOC,  SNCOC) 
CENTRALLY  DIRECTED  BY  DA  (SCHEDULED  WITHIN  ONE  YEAR) 

•  NCOA- ADM I N I  ST  E  RE  D  COURSES  (PLC,  PNCOC,'  BNCOC)  CONTINUE  WITH 
DECENTRALIZED  SELECTION,  BUT  UNDER  SPECIFIC  POLICY  ESTABLISHED 
BY  DA 


AS  REVISED  (CH  5.  AR  351-1 


•  ARMY  TRAINS  NCO  AVAILABLE 


TRAIN  BEST  QUALIFIED/NCO  WHO 
OCCUPY  KEY  JOBS 


•  NO  ARMY  NCOES  TRAINING  PRIORITIES 


ESTABLISHES  ARMY  TRAINING 
PRIORITIES 


PROMOTION  LISTED  NCO 
NCO  IN  JOB 


DA  SCHEDULES  RESIDENT  TNG 
(CONTROLLING  FUNDS) 


CDRS  NOT  COMPELLED  TO  PROVIDE  NCO 
TO  RESIDENT  TRAINING  (FY  79  PTC 
«=  .55%  SHORTFALL;  FY  79  BTC 
■  .66%  SHORTFALL) 


•  TNG  $  DO  NOT  PRODUCE  TRAINED  NCO 
WORKING  IN  JOB  FOR  WHICH  TRAINED 


TRAINED  NCO  WORKS  IN  JOB  FOR 
WHICH  TRAINED 


fal.yj'.A. >A»i »Y 


POLICY  DIRECTION  TO  FORMALIZE  NCOES 


PROMOTION  BASED  ON  PERFORMANCE  AND  CDR'S  RECOMMENDATION;  SQT  SCORE 
OF  00  TO  BE  RETAINED  AS  A  STATED  OBJECTIVE 


FORMAL  TRAINING,  WHENEVER  NECESSARY,  FOLLOWS  SELECTION  FOR  PROMOTION 
AND  PRECEDES  JOB  USE  AT  NEXT  HIGHER  SKILL  LEVEL 


®  NCOES  ON  TDY  AND  RETURN  BASIS,  SO  LOSING  CDR  IS  BENEFITING  CDR 


FORMAL  COURSES  NOT  LOCALLY  AVAILABLE  (PTC,  BTC,  ANCOC,  SNCOC) 
CENTRALLY  DIRECTED  BY  DA  (SCHEDULED  WITHIN  ONE  YEAR) 

NCOA- ADMINISTERED  COURSES  (PLC,  PNCOC,  BNCOC)  CONTINUE  WITH 
DECENTRALIZED  SELECTION,  BUT  UNDER  SPECIFIC  POLICY  ESTABLISHED 
BY  DA 


POLICY  WILL 


ALLEVIATE  SYSTEMS  PROBLEMS 


CORRECT  SERIOUS  UNDERATTENDANCE 


PROVIDE  EFFECTIVE,  COST  EFFICIENT  FRAMEWORK  FOR  TD  EFFORT 


CURRENT  STATUS:  (AR  35T-1) 

DA/MACOM  STAFFING  W/3T  AUG  SUSPENSE  TO  DA  DCSOPS  (MG  SMITH) 


NEXT;  (AR  350-1)  • 

—  BEING  STAFFED  W/MACOM  -  TRADOC  INPUT  INSURES  ALL  TRAINING  POLICY 


DOCUMENTS  ARE  IN  SYNCH 


r* */vnrv ff 


ANALYSIS 

AND 

THE 

ENLISTED 

TRAINING 

STRATEGY 


COMMANDANT  *  S-TRAINING 
STRATEGY 

CRITICAL  TASK  LIST 
SITE  SELECTION 
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PRESENT  STRATEGY 


GRADE  I  IET/NCOES 


SENIOR 


SGM  ACADEMY  (20  WKS) 
(DA  Selection) 


ACCP  (DA  SELECTION )SM,  SPAS. 
TEC,  ARTEPS,  ETV/DAMP,  SOJT 
(OPS/  INTEL) 


DVANCED 


ANCOC  (10-12  WKS) 
(DA  Selection) 


BNCOC  (4  WKS) 
(Unit  Selection) 


|  PRIMARY 

E4  PNCOC  (4  WKS) 

(2  yrs'  (Unit  Selection) 


ACCP,  SM,  SQT,  SPAS,  TEC, 
JTP,  ARTEPS,  ETV/DAMP,  SOJT 
(OPS/INTELL) 


ACCP,  SM,  SQT,  SPAS,  TEC,  JT 
ARTEPS,  LTV/DAMP 


JOB  BOOK,  SM,  SPAS,  TEC,  JTP 
ETV/DAMP,  ARTEPS,  SQT 


INITIAL  ENTRY  TRAINING 


CIV-E1 


OSUT  (12  WKS) 
(Mandatory) 


SMART  BOOK,  SM,  SPAS,  TEC 


SL  1  TASKS 


SPECIALTY  TRAINING 


E6-E9  SPECIAL  FORCES  (16  WKS)  (VOL) 

E5-E-7  DRILL  SGT  SCHOOL  (6  WKS)  (DA  Selection) 
E6-E7  INF  MORTAR  COURSE  (6  WKS) 


ALL  f  DRAGON  TNR  (2  WKS) 
RANKS  1  TOW  TNR  (3  WKS) 

(  RANGER  (9  WKS) 


AIRBORNE  (3  WKS) 
PATHFINDER  (3  WKS) 
it  AIRASSAULT  (1  1/2  WKS) 


INFANTRYMAN'S  CAREER  PROGRESSION  UNDER  EPMS 


IET 


SHORT  FALLS  IN  STRATEGY 


ENLISTED  TRAINING  STRATEGY  NEVER  PREVIOUSLY  ARTICULATED. 

ELEMENTS  EVOLVED  IN  ISOLATION 
SITE  SELECTION  BY  HAPPENSTANCE 
IET  TRAINS  TOO  FEW  TASKS 
TRAINED  NCO  KEY  TO  UNIT  TRAINING  BUT: 

SHORTCHANGED  IN  TECHNIQUE  TRAINING 
FEW  ATTEND  NCOES 
PNCOC  211  of  all  E4  per  year 
BNCOC  28%  of  all  E5  per  year 
ANCOC  10%  of  all  E6  per  year 
SMA  3%  of  all  1  IB  E8/9  per  year 

JR  NCO  IS  PRIME  UNIT  TNR  BUT  HIS  TECHNICAL  (SM)  TNG  LEFT  TO  SELF/UNIT 
MANY  NCO  FILL  NEXT  HIGHER  GRADE  SLOTS 
CMF  PROBLEMS: 

1SG/0PNS/INTELL  POSITIONS  NEED  TRAINING 
11C/H  HAVE  DIFFICULTY  INTEGRATING  IN  1  IB  AT  SL  5 
TRAINING  SUPPORT  PRODUCTS 


NOT  COORDINATED 


USAIS  APPROACH 


UNIT 

READINESS 


ARTEP 


INSTITUTIONAL 

TNG 


LEADERSHIP 


Train  To  Train 


INDIVIDUAL 

SKILLS 

^(Soldier's 

^Manual) 


COLLECTIVE 
^  SKILLS 

(How  To 
;l  Fight) 


UNIT  TNG 
PLUS 
TNG  SPT 


■TRAINED  NCO 


HARD  SKILL/SOFT  SKILL 
RELATIONSHIP 


SKILL  LEVEL  1  2  3  A 

COMMON  TASKS  86  5D  51  27 


PVT  SP4  SGT  SSG  PSG  1SG 

SFC  MSG 


LEADERSHIP  MANAGERIAL  SKILL 


PRESENT 


1979 


1982 


SKILL  LEVEL  1 

COMMON 

TOTAL 

SKILL  LEVEL  2 
COMMON 
TOTAL 

SKILL  LEVEL  5 
COMMON 
TOTAL 

SKILL  LEVEL  A 
COMMON 
TOTAL 


INST/UNIT 

442/562 

292/71% 

inst/unit 

751/271 

521/Wo 

ihst/unit 

862/142 

532/472 

Wo/561 

571/651 

522/482 

31%/69% 

412/59 % 

402/602 

31%/69% 

28%/72% 

762/242 

742/262 

962/42 

852/152 

35%/15% 

472/532 

812/19% 

672/332 

% 

1002/02 

862/142 

'  22I 

• 

ENLISTED  TRAINING  STRATEGY  FOR  CMF  11 


BY 

MG  DAVID  E.  GRANGE,  JR. 

COMMANDANT,  UNITED  STATES  ARMY  INFANTRY  SCHOOL 


(SLIDE  #  1-ETS  CMF  11) 


THE  INFANTRY  SCHOOL  IS  DEDICATED  TO  DEVELOPING  THE  WORLD'S  BEST 
TRAINED  INFANTRY  SOLDIER  -  ONE  WHO  CAN  FIGHT  AND  WIN.  TO  DO  THIS 
WE  MUST  FIRST  LOOK  AT  THE  TRAINING  REQUIREMENT  TO  DETERMINE  WHETHER' 
OUR  TRAINING  IS  IN  FACT  MEETING  THE  NEED.  ALL  OUR  TRAINING 
ULTIMATELY  IMPACTS  ON  UNITS  IN  THE  FIELD  AND  WE  MUST  REALIZE  THAT  * 
OUR  MISSION  IS  TO  SUPPORT  THEM. 

♦ 

IT  IS  ONLY  LOGICAL  TO  ASSUME  THAT  WHAT  WE  DO  IN  THE  INSTITUTION 
MUST  BE  SUPPORTIVE  OF  THE  UNITS  IN  THE  FIELD.  THERE  WOULD  BE 

(SLIDE  #  2  -  USA IS  STRATEGY) 

LITTLE  ARGUMENT  IN  CONSIDERING  THAT  THE  ULTIMATE  GOAL  OF  ANY  UNIT 
IS  COMBAT  READINESS.  SINCE  THE  CURRENT  MEASURE  OF  THAT  READINESS 
IS  THE  ARTEP,  THEN  IT  WOULD  FOLLOW  THAT  ALL  WE  DO  MUST  SUPPORT  THE 
ARTEP.  THERE  ARE  THREE  PRINCIPLE  INGREDIENTS:  LEADERSHIP, 
INDIVIDUAL  SKILLS  AND  COLLECTIVE  SKILLS.  THE  RESPONSIBILITY  FOR 
TRAINING  THESE  SKILLS  IS  SHARED  BY  THE  INSTITUTIONS  AND  UNITS  BUT 
THERE  ARE  SOME  THINGS  THAT  EACH  OF  US  CAN  DO  BETTER,  AT  THE 


SCHOOLS  WE  ARE  BETTER  EQUIPPED  TO  CONCENTRATE  ON  FORMAL  LEADERSHIP 
TRAINING  AND  WE  CAN  BEST  CONDUCT  THE  INITIAL  TRAINING  OF  MOST  OF 
THE  NEEDED  INDIVIDUAL  SKILLS  WHILE  THE  UNITS  BETTER  HANDLE  COLLECTIVE 
TRAINING  AND  MANY  OF  THE  DUTY  POSITION  PECULIAR  INDIVIDUAL  SKILLS. 

*HE  END  RESULT  OF  OUR  TRAINING  IS  TO  PRODUCE  A  TRAINED  SOLDIER  OR 
NCO  WHO  IS  PREPARED  TO  FIGHT  IMMEDIATELY  UPON  JOINING  HIS  UNIT  IN 
WAR  OR  HELP  HIS  UNIT  TRAIN  IN  PEACETIME.  ADD  TO  THIS  THE  TRAINING 
SUPPORT  THAT  WE  PROVIDE  THE  UNIT  AND  HIS  ROLE  IS  FURTHER  STRENGTHENED. 
IN  SHORT,  EVERYTHING  THAT  WE  DO  SHOULD  BE  ARTEP  SUPPORTIVE,  WHETHER 
IT  BE  THE  SOLDIER  WE  TRAIN  IN  OSUT,  THE  TRAINER  WHO  GRADUATES  FROM' 
NCOES,  OR  THE  EXPORTABLE  PRODUCTS  WE  SEND  TO  THE  FIELD  TO  SUPPORT 
UNIT  TRAINING.  EXACTLY  WHAT  KIND  OF  A  GRADUATE  DO  WE  WANT  TO  PRODUCE 
FROM  OUR  COURSES?  IF  WE  LOOK  AT  THE  WORLD  OF  THE  PRIVATE  BEING 
COMPOSED  OF 


(SLIDE  n  3  -  HARD/SOFT  SKILL  RELATIONSHIP) 


PRIMARILY  THE  HARD  (I.E.,  SOLDIER'S  MANUAL)  SKILLS  AND  THAT  OF  THE 
CSM  CONTAINING  LITTLE,  IF  ANY,  SUCH  SKILLS  BUT  PRIMARILY  THE  SOFTER 
(LEADERSHIP/MANAGEMENT)  SKILLS,  THEN  WE  HAVE  A  RELATIONSHIP  THAT 

LOOKS  SOMETHING  LIKE  THIS:  THE  LOWER  THE  RANK,  THE  MORE  HARD  SKILL 

\ 

PROFICIENCY  IS  NEEDED  TO  DO  THE  JOB;  THE  HIGHER  THE  RANK,  THE  MORE 
LEADERSHIP  IS  USED.  OUR  TRAINING  THEN,  SHOULD  PARALLEL  THIS 
PHILOSOPHY  AND  PLACE  A  GREATER  EMPHASIS  ON  HARD  SKILL  TRAINING 
AT  THE  LOWER  RANKS. 
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IN  THE  AREA  OF  TRAINING  SUPPORT,  OUR  PRIMARY  EFFORT  SHOULD  BE 
DIRECTED  TOWARD  THOSE  AREAS  THAT  ARE  NOT  TRAINED  IN  THE  INSTITUTION 
BUT  ARE  INITIALLY  TRAINED  IN  THE  UNITS  IN  SUPPORT  OF  THEIR  ARTEP 
MISSIONS.  WE  WILL  CONTINUE  TO  PRODUCE  PRODUCTS  THAT  REFRESH  AND  ♦  r 
REINFORCE  WHAT  WE  TRAIN  IN  THE  INSTITUTION  BUT  THIS  WILL  BE  OUR  ' 
SECONDARY  EFFORT.  FOR  EXAMPLE,  MOST  DUTY  POSITION  PECULIAR  TRAINING# 
SUCH  AS  THAT  FOR  MECHANIZED  CARRIER  TEAM  LEADERS  OR  FOR  RADIO 
OPERATORS  IS  LEFT  TO  THE  UNITS  TO  CONDUCT;  WE  WILL  FOCUS  OUR  EX-  * 
PORTABLES  TO  SUPPORT  THESE  AREAS.  COMMON  TASK  SUBJECTS  LIKE  M16  RIFLE 
AND  HAND  GRENADES  THAT  WE  TRAIN  IN  OSUT  WILL  BE  DEVELOPED  AS  REVIEW 
OR  REFRESHER  TRAINING.  WITH  THIS  AS  OUR  STRATEGY  FOR  TRAINING  IN¬ 
FANTRYMEN,  LET'S  TAKE  A  LOOK  AT  WHAT  WE  ARE  DOING  NOW  AND  HOW 
WE  STACK  UP  AGAINST  IT. 

(SLIDE  #  A  -  PRESENT  SYSTEM) 

FIRST,  HERE'S  OUR  PRESENT  SYSTEM.  THIS  SHOWS  THE  TRAINING  AVAILABLE 
FOR  CMF  11  SOLDIERS  FROM  RECRUIT  TO  SGM.  THE  RELATIONSHIP  OF 
INSTITUTION  TO  UNIT  TRAINING  IS  SHOWN  BY  THE  BAR  GRAPH  DEPICTING 
THE  SOLDIER'S  MANUAL  SKILLS  TAUGHT  IN  THE  INSTITUTION  -  THOSE  SKILL 


LEVEL  TASKS  UNDER  THE  IET/XOES  CATEGORY  -  VERSUS  WHAT  IS  LEFT 
TO  THE  UNITS  TO  INITIALLY  TRAIN  -  THAT  PART  OF  THE  BAR  UNJER  THE 
UNIT  HEADING.  UNDER  THE  TRAINING  SUPPORT  COLUMN,  VARIOUS  EXPORTABLES 
ARE  LISTED  FOR  EACH  LEVEL.  THE  SPECIALTY  COURSES  LISTED  AT  THE 

Bottom  round  cut  the  .system  owe  thing  that  is  immediately  alarming 

IS  THE  HIGH  PERCENTAGE  OF  CRITICAL  (SOLDIER'S  MANUAL)  TASKS  LEFT 
FOR  THE  UNITS  TO  TRAIN.  WE'LL  TALK  ABOUT  THIS  U  GREATER  DETAIL 
LATER. 

NEXT.  LET'S  ADD  EPMS  TO  THE  TRAINING  PLAN .  AS  SHOWN  OX  THE 

(SLIDE  if  S  -  EPMS) 

PREVIOUS  SLIDE,  NEITHER  IET  NOR  NCOES  QUALIFIES  A  SOLDIER  FOR  A 
SKILL  LEVEL  BUT  ONLY  SERVES  AS  A  TRANSITION.  SKILL  LEVEL  FIVE 
GLARINGLY  LACKS  EVEN  THIS  TRANSITION.  THOSE  FEW  WHO  ATTEND  THE 
SERGEANT  MAJOR  ACADEMY  ARE  ALREADY  SKILL  LEVEL  FIVE.  THE  1IC 
AND  11H  MGS  BOTH  MERGE  WITH  THE  11B  HOS  At  SKILL  LEVEL  FIVE. 

NON,  LET'S  EVALUATE  WHAT  WE  HAVE  IN  COMPARISON  TO  OUR 

(SLIDE  it-  5  -  FINDINGS) 

ARTICULATED  STRATEGY.  FIRST,  WE  CHECKED  TO  SEE  WHETHER  OUR  SOLDIER'S 
MANUALS  FULLY  SUPPORT  THE  ARTEP.  WHILE  WE  FOUND  THAT  WE  COULD  MAKE 
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A  BETTER  MATCH-UP  BETWEEN  THE  TWO,  GENERALLY, SOLDIERS  WHO  WERE 
TRAINED  IN  THE  SOLDIER'S  MANUAL  SKILLS  MAKE  UNITS  WHICH  PERFORM 
WELL  ON  THE  ARTEP, 

S1TL_S£LELT1QM=  . 

NEXT,  USING  OUR  11B  MOS  AS  AN  EXAMPLE,  WE  FOUND  THAT  NOT 

AS  MANY  OF  THE  CRITICAL  SOLDIER'S  MANUAL  SKILLS  WERE  TAUGHT  IN  THE  „ 

%■» 

(SLIDE  #  7  -  11B  CRITICAL  SKILLS) 

INSTITUTION  AS  SHOULD  BE.  THE  VARIOUS  COURSE  POI  WERE  DEVELOPED 
PRIOR  TO  THE  FRUITION  OF  THE  ISD  PROCESS,  THE  PRESENT  UNIT  TRAINING 
ENVIRONMENT  WAS  NOT  ACCURATELY  PREDICTED,  AND  AN  UNACCEPTABLY  HIGH 
PERCENTAGE  OF  INDIVIDUAL  TRAINING  WAS  LEFT  TO  THE  UNITS  TO  ACCOMPLISH. 
FURTHERMORE,  DUE  TO  LOW  ENTRY  LEVELS  AT  NCOES  COURSES  SOME  TASKS, 

SUCH  AS  THOSE  ON  THE  LAW  AND  CLAYMORE  MINE,  ARE  REPEATED  FROM  IET 
THROUGH  ANCOC.  LET  ME  EXPLAIN  THIS.  WE  ARE  COMMITTED  TO  REINITIATING 
THE  EVALUATION  OF  ANCOC  STUDENTS  UPON  ENTRY  AS  WE  SUSPECT  THAT  AS 
THE  SQT  TEMPO  IN  THE  FIELD  INCREASES,  REQUIREMENTS  FOR  RETRAINING 
LOWER  LEVEL  SKILLS  IN  THE  INSTITUTION  WILL  BE  REDUCED. 

(SLIDE  U  8  -  SITE  SELECTION  RESULTS) 

A  RECENT  SITE  SELECTION  BOARD,  HOWEVER,  EVALUATED  THE  ENTIRE  MOS 
ON  A  TASK  BY  TASK  BASIS  AND  RECOMMENDED  A  DIFFERENT  DISTRIBUTION  OF 


RESPONSIBILITY  BETWEEN  INSTITUTION  AND  UNIT.  THE  BOARD  WAS  TASKED 
WITH  RECOMMENDING  THE  BEST  TRAINING  SITE  FOR  EACH  TASK  AND  WAS  NOT 
CONSTRAINED  BY  RESOURCE  CONSIDERATIONS.  HOW  MUCH  WE  CAN  ACTUALLY 
IMPLEMENT  BASED  ON  THE  AVAILABILITY  OF  ASSETS  IS  CURRENTLY  UNDER 
•  EVALUATION.  BUT,  THE  MAIN  POINT  IS  THAT  MANY  MORE  TASKS  -  ESPECIALLY 
’  flit  COMMON  CORE  TASKS  -  SHOULD  BE  INITIALLY  TRAINED  IN  THE  INSTITUTION. 

DETAILED  LOOK  AT  OUR  INSTITUTIONAL  COURSES  AND  TRAINING  SUPPORT 
RESULTED  IN  THE  FOLLOWING  FINDINGS: 

INITIAL  ENTRY  TRAINING 

WHILE  ONLY  38  OUT  OF  86  REQUIRED  COMMON  CORE  TASKS  ARE  TRAINED 
TO  SKILL  LEVEL  ONE  PROFICIENCY,  THE  BURDEN  ON  UNIT  TRAINING  IS 
SOMEWHAT  LESSENED  BY  THE  FACT  THAT  25  OTHER  TASKS  ARE  TAUGHT  - 
BUT  TO  LESS  THAN  SKILL  LEVEL  ONE  STANDARDS  -  MAKING  SUBSEQUENT 
UNIT  TRAINING  EASIER. 

WE  CONTEND  THAT  THE  TRAINED  NCO  IS  THE  KEY  TO  UNIT  TRAINING.  LET'S 
LOOK  AT  HOW  WE  ARE  IN  FACT  TRAINING  HIM. 

ENCQC 

TWENTY-TWO  OUT  OF  50  COMMON  TASKS  FOR  SKILL  LEVEL  TWO  ARE  TRAINED 
IN  PNCOC.  THE  CURRENT  EMPHASIS  IS  ON  LEADERSHIP  TRAINING.  HOWEVER, 

OUR  EARLIER  COMPARISON  OF  HARD  VERSUS  SOFT  SKILLS  CONCLUDED  THAT 
MORE  TECHNICAL  PROFICIENCY  THAN  LEADERSHIP  TRAINING  IS  NEEDED 
FOR  THE  LOWER  ENLISTED  GRADES.  THEREFORE,  IT  SEEMS  THAT  AS  NOW 
STRUCTURED,  PNCOC  GIVES  THE  YOUNG  NCO  THE  FORM  IN  HOW  TO  LEAD 
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AND  HOW  TO  TRAIN  BUT  DOES  NOT  PROVIDE  ENOUGH  SUBSTANCE,  I.E.,  TECHNI¬ 
CAL  PROFICIENCY. 


Mm 

16  OUT  OF  51  COMMON  SKILLS  ARE  TRAINED  IN  BNCOC.  THE  AMOUNT 
OF  DUTY  POSITION  SPECIFIC  TASKS  TAUGHT  VARY  IN  ACCORDANCE  WITH 
LOCAL  COMMANDER'S  DESIRES.  LOWER  SKILL  LEVEL  TASKS  AND  NON¬ 
SOLDIER'S  MANUAL  TASKS  ARE  BEING  TAUGHT  AT  THE  EXPENSE  OF  THE  SKILL 
LEVEL  THREE  CRITICAL  SKILLS. 

ANm 

THE  MOST  TECHNICAL  TRAINING  OF  ALL  THE  COURSES  IS  DONE 
AT  ANCOC.  23  OUT  OF  27  COMMON  SKILL  LEVEL  FOUR  TASKS  ARE  TRAINED 
AS  WELL  AS  REVIEWING  MANY  (93)  SKILL  LEVEL  ONE  THROUGH  THREE  TASKS. 
WHILE  THE  COURSE  IS  DESIGNED  TO  PREPARE  AN  NCO  TO  BE  A  PLATOON 
SERGEANT,  91%  OF  THE  ATTENDEES  CLAIM  TO  HAVE  HAD  THAT  JOB  AT  SOME 
TIME  PRIOR  TO  ATTENDANCE,  AND  ONLY  28%  RETURN  TO  THAT  JOB  AFTER 
ANCOC.  TOO  MUCH  TRAINING,  TOO  LATE.  WE  NEED  A  BETTER  WAY  TO  MATCH 
THE  TRAINING  WITH  THOSE  WHO  WILL  DO  THE  JOB. 

SERGIANT-MAJQR  ACADEMY 

MY  PERCEPTION  IS  THAT  IF  AN  NCO  IS  A  TRAINER  AND  THE  NAME  OF  THE 
GAME  IS  TO  TRAIN  TRAINERS,  THEN  THE  MAIN  ROLE  OF  THE  SERGEANT 
MAJOR  IS  THE  DEAN  OF  TRAINERS.  MILPERCEN  SHOULD  MAKE  A  DETERMINED 
EFFORT  TO  GEAR  THEIR  SELECTIONS  MORE  TOWARD  SENIOR  E-8'S  AND  HAVE 
THEM  ATTEND  THE  SERGEANT  MAJOR  ACADEMY  EARLY.  THESE  GRADUATES 
MUST  THEN  REPORT  IMMEDIATELY  TO  OUR  UNITS  IN  THE  FIELD. 
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A  GAP  EXISTS  AT  THE  SENIOR  LEVEL.  A  COURSE  DOES  NOT  EXIST 
TO  TRAIN  THE  SKILL  LEVEL  FOUR  SOLDIER  TO  BECOME  A  SKILL  LEVEL  FIVE. 
THE  TWO  MAJOR  JOBS  AT  THAT  LEVEL  ARE  FIRST  SERGEANT  AND  OPERATIONS/ 
**  INTELLIGENCE  SERGEANT  -  BOTH  ABOUT  EQUALLY  DISTRIBUTED  AT  39%  OF 
THE  SKILL  LEVEL.  BOTH  JOBS  REQUIRE  SPECIFIC  TRAINING.  WHILE  THERE 
*  ARE  A  FEW  LOCAL  1SG  COURSES  BEING  CONDUCTED,  UNITS  IN  THE  FIELD 
SUPPORT  OUR  CONTENTION  THAT  THERE  IS  A  NEED  FOR  A  FORMAL  1SG  COURSE, 
AS  WELL  AS  OPERATIONS/ INTELLIGENCE  TRAINING. 

* 

NCOES  ATTENDANCE 

WHAT  IS  MOST  ALARMING  IS  THE  NUMBER  WHO  ACTUALLY  ATTEND  NCOES. 

AS  YOU  CAN  SEE  IT  IS  PITIFULLY  SMALL.  THIS  PROBLEM  IS  FURTHER 
COMPOUNDED  BY  THE  FACT  THAT  SINCE  IT  WAS  NOT  TAUGHT  IN  THE  INSTI¬ 
TUTION  MOST  OF  THE  JR.  NCO'S  TECHNICAL  (SOLDIER'S  MANUAL)  TRAINING 
IS  LEFT  TO  EITHER  THE  INDIVIDUAL  OR  THE  UNIT.  ADD  TO  THIS  THE 
FACT  THAT  MANY  NCO'S  FILL  POSITIONS  CALLING  FOR  AT  LEAST  ONE  HIGHER 
GRADE  THAN  THEY  HOLD.  AND  THEN  WE  SAY  THAT  THE  JR.  NCO  IS  THE 
PRIME  UNIT  TRAINER.  WE  CHARGE  THE  NCO  WITH  THE  JOB  OF  TRAINING, 

BUT  WE  DO  NOT  PROVIDE  HIM  WITH  THE  TOOLS  OF  THE  TRADE. 

SPECIALTY.  COURSES 

WHILE  THE  INFANTRY  MORTAR  COURSE  AND  THE  TOW  TRAINER  COURSE  DUPLICATE 
MUCH  OF  THE  ANCOC  POI,  THERE  IS  STILL  A  STRONG  NEED  FOR  THESE  COURSES. 
THEY  PROVIDE  A  RESPONSIVE  OPTION  FOR  COMMANDERS  OF  OPERATIONAL  UNITS 


TO  SEND  SOLDIERS  OF  THEIR  CHOICE,  NOT  NECESSARILY  THOSE  SELECTED  BY 
MILPERCEN  FOR  ANCOC  ATTENDANCE,  TO  BECOME  THE  WEAPONS  SYSTEM  EXPERTS 
WHO  ARE  DESPERATELY  NEEDED  RIGHT  NOW  TO  TRAIN  OUR  SOLDIERS  IN  THESE 
CRITICAL  SKILLS, 

TRAINING  SUPPORT 

WHILE  OUR  TRAINING'  SUPPORT  IS  VARIED  AND  VOLUMINOUS,  WE  ARE  STILL 
NOT  SATISFIED,  THE  INFANTRY  SCHOOL  IS  WORKING  HARD  TO  ASSURE 
THAT  THE  PRODUCTS  ARE  TIMELY,  UP-TO-DATE  AND  SYNCHRONIZED  WITH 
THE  REST  OF  THE  TRAINING  DEVELOPMENT  EFFORT,  THERE  IS  PARTICULARLY 
A  NEED  FOR  THIS  WITH  OUR  RESERVE  COMPONENTS. 

ONE  AREA  THAT  NEEDS  IMPROVEMENT  IS  THAT  WE  HAVE  NEITHER  TOLD  NOR 
SOLD  THE  ENTIRE  TRAINING  SYSTEM  TO  THE  FIELD  -  ESPECIALLY  TO  THE 
NCO,  ANCOC  IS  THE  FIRST  COURSE  WHERE  WE  REALLY  EXPLAIN  THE  RELATION¬ 
SHIP  OF  SOLDIER'S  MANUALS,  SQT,  ARTEP,  TEC,  ETC,  THIS  MUST  ALSO  BE 
DONE  TO  SOME  DEGREE  IN  PNCOC  AND  BNCOC  KEYING  ON  SOLDIER'S  MANUALS, 

SQT,  ARTEP,  TEC,  JOB  BOOKS,  REALTRAIN,  SPAS,  AND  JTP. 

£ME 

WHILE  THE  11C  AND  11H  SOLDIERS  MAY  HAVE  SOME  DIFFICULTY  MERGING 
AT  SKILL  LEVEL  FIVE  WITH  11B  MOS,  THIS  PROBLEM  IS  NOT  MONUMENTAL, 

THE  MAJOR  DIFFICULTY  WE  SEE  IS  A  NEED  TO  TRACK  OPERATIONS/ 

(SLIDE  #  9  -  OPS/INTEL)  ■ 

INTELLIGENCE  NCO.  AS  CAN  BE  SEEN  FROM  THE  SLIDE,  THE  CAREER  PROGRESS IC 
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IS  SOMEWHAT  MUSHROOM  SHAPED.  RATHER  THAN  TRYING  TO  ARTIFICALIY 
FLESH  OUT  THE  BASE,  BASED  ON  PRESENT  JOBS,  THE  BEST  COURSE  SEEMS  TO 
BE  TO  BEGIN  AT  SKILL  LEVEL  FOUR  WHERE  26£  OF  THE  11B4  JOBS  ARE  NOW 
OPERATIONS  AND  INTELLIGENCE  SPECIFIC  AND  THERE  IS  A  REGULAR  PRO¬ 
GRESSION  FROM  THERE.  • 

REMEMBERING  THAT  OUR  STRATEGY  IS  CENTERED  ON  BEING  PREPARED  TO  FIGHT 
AND  TO  MEASURE  THIS  READINESS  BY  THE  ARTEP,  WE  LOOKED  AT  WAYS  TO 
IMPROVE  OUR  PRESENT  SYSTEM  BY  BRINGING  IT  CLOSELY  ON  LINE  WITH  OUR 
STRATEGY.  WE  FIRST  CONSIDERED  OUR  CAPABILITIES, 

(SLIDE  #10  -  GEN  STARRY  REQUIREMENT  ON  CAPABILITIES) 

WHAT  WE  CAN  DO  WITH  WHAT  WE  HAVE. 

(DIE:  PAUSE  TO  PERMIT  READING  OF  SLIDE  #  10) 

(SLIDE  #  11  -  CAPABILITIES) 

ARTEP  AND  SOLDIER'S  MANUALS  HAVE  TO  LINE  UP  BETTER.  WE  ARE  UNDERTAKING 
A  PROJECT  TO  DEFINE  THE  ARTEP  COLLECTIVE  TASKS  IN  TERMS  OF  THE 
INDIVIDUAL  TASKS;  THIS  WILL  PROVIDE  A  READY  CROSS-REFERENCE  SYSTEM 
FOR  USING  UNITS. 

OUR  NCO  COURSES  MUST  USE  ARTEP  AND  SOLDIER'S  MANUAL  TERMINOLOGY 
WHENEVER  POSSIBLE.  IF  "HOW  TO  FIGHT"  SKILLS  ARE  TAUGHT,  THEY  MUST 
IMMEDIATELY  BE  CONVERTED  TO  THE  APPROPRIATE  ARTEP  ELEMENTS  AND 
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DISCUSSED  IN  TERMS  OF  THE  TRAINING  AND  EVALUATION  OUTLINES  FOR 
FIELD  CRITIQUES;  INDIVIDUAL  DISCREPANCIES  MUST  THEN  BE  CRITIQUED  IN 
TERMS  OF  THE  APPROPRIATE  SOLDIER'S  MANUAL  TASKS, 

WE  HAVE  ALREADY  BEGUN  A  SITE  SELECTION  PROCESS  THAT  HAS  GIVEN  US  A 
BETTER  PERSPECTIVE  ON  INSTITUTIONAL  AND  UNIT  RESPONSIBILITY.  LOOKING  -• 
AT  THE  ENTIRE  MOS  AT  ONE  TIME  INSTEAD  OF  ON  A  COURSE  BY  COURSE  * 

BASIS  HAS  HELPED  US  TO  MINIMIZE  INCONSISTENCIES  AND  AVOID  DUPLICATION 
OF  EFFORT. 

WE  CAN  DO  BETTER  IN  PACKAGING  OUR  EXPORTABLES.  JOB  TRAINING  PACKAGES 
ARE  A  STEP  IN  THE  RIGHT  DIRECTION,  PROVIDING  A  COMPLETE  PICTURE  OF 
THE  TRAINING  NEEDED  FOR  A  DUTY  POSITION.  THIS  IS  VITAL  TO  THOSE 
NCO'S  WHO  ARE  NOT  AFFORDED  THE  OPPORTUNITY  TO  ATTEND  NCOES.  THE 
COMMANDER'S  MANUAL  CONTINUES  TO  BE  MISUNDERSTOOD  OR  UNUSED;  WE  CAN 
SELL  IT  AND  PACKAGE  IT  BETTER.  (ONE  WAY  MAY  BE  TO  COLOR  CODE  SOLDIER'S 
MANUAL  PAGES  OF  THOSE  TASKS  NOT  TAUGHT  IN  THE  INSTITUTION.) 

USING  THE  NEW  FM  22-100,  HOW  TO  LEAD,  AND  THE  TASK  LISTS  AS  DEVELOPED 
AT  THE  MARCH  1979  TRADOC  LEADERSHIP  CONFERENCE,  WE  ARE  NOW  ABLE  TO 
PROVIDE  NCOES  WITH  A  SYSTEM  OF  LEADERSHIP  TRAINING  FOR  EACH  GRADE. 

THIS  WILL  NOT  ONLY  PROVIDE  A  SYSTEM  OF  PROGRESSIVE,  FORMAL  TRAINING 
BUT  WILL  SERVE  AS  A  GUIDE  FOR  THE  ONGOING  DEVELOPMENT  OF  LEADERS  IN 
THE  UNITS. 

(SLIDE  #  12  -  GEN  STARRY  REQUIREMENT  ON  RESOURCES) 

(NOTE:  PAUSE  TO  PERMIT  READING  OF  SLIDE  #  12) 


HOWEVER,  THE  CRUX  OF  THE  PROBLEM  LIES  BEYOND  OUR  ABILITY  TO  INFLUENCE, 
(SLIDE  #  13  -  RESOURCES  NEEDED) 

SIMPLY,  TOO  FEW  NCO  ATTEND  NCOES.  MANY  MORE  COURSES/ALLOCATIONS 
ARE  NEEDED. 

WHILE  ADDITIONAL  TECHNICAL  (SOLDIER'S  MANUAL)  SKILLS  CAN  BE  ADDED  TO 
PNCOC/BNCOC  THROUGH  A  MORE  JUDICIOUS  MANAGEMENT  OF  THE  POI,  A  GREATER 
EFFORT  MUST  BE  MADE  TO  DEVELOP  THE  TECHNICAL  PROFICIENCY  OF  THE 
JUNIOR  NCO  IN  THE  UNIT  THROUGH  AVAILABLE  TRAINING  SUPPORT. 

MILPERCEN  ASSISTANCE  IS  NEEDED  TO  FULFILL  THE  ANCOC  OBJECTIVE  OF 
TRAINING  PLATOON  SERGEANTS.  ALL  -  OR  EVEN  MOST  -  GRADUATES  DO 
NOT  GO  DIRECTLY  TO  PLATOONS  AFTER  COMPLETING  THE  COURSE.  LET  ME 
STRESS  THE  MAGNITUDE  OF  THIS  PROBLEM.  AS  I  STATED  EARLIER  ONLY 
10%  OF  THOSE  ELIGIBLE  ATTEND  ANCOC  AND  ONLY  ONE  THIRD  OF  THESE 
GRADUATES  RETURN  DIRECTLY  TO  A  UNIT.  WE  ARE  NOT  CAPITALIZING  ON 
OUR  TRAINING  INVESTMENT;  WE  NEED  AN  IMMEDIATE  IMPACT  ON  UNIT 
PROFICIENCY.  WHAT  WE  HAVE  NOW  IS  A  WASTE. 

A  SKILL  LEVEL  FIVE  1SG  COURSE  CAN  BE  ESTABLISHED  AT  THE  INFANTRY 
SCHOOL  BUT  A  BETTER  SOLUTION  WOULD  BE  TO  ESTABLISH  A  COURSE  AT 
LOCAL  NCO  ACADEMIES  TO  PERMIT  SOME  TAILORING  FOR  LOCAL  REQUIREMENTS. 

WE  STAND  READY  TO  ASSIST  IN  DEVELOPING  AN  EXPORTABLE  COURSE. 


AS  A  MATTER  OF  INTEREST,  WE  CONDUCTED  A  RECENT  SURVEY  AND  DISCOVERED 
THAT  INFANTRY  DIVISIONS  AND  SEPARATE  BRI6ADES  ARE  SERVED  BY  FIVE 
STATESIDE  AND  THREE  OVERSEAS  LOCALLY  ESTABLISHED  ISO  COURSES  THAT 
RANGE  FROM  3  DAYS  TO  A  WEEKS  IN  DURATION.  FIELD  SUPPORT  FOR 
INSTITUTING  A  FORMAL  1SG  COURSE  IS  OVERWHELMING. 

(SLIDE  k  14  -  GEN  STARRY  RESTRUCTURE  CMF 
REQUIREMENT) 

(NOTE:  PAUSE  TO  PERMIT  READING  OF  SLIDE  14) 

(SLIDE  #  15  -  RESTRUCTURE  CMF) 

THE  OPERATIONS/INTELLIGENCE  NCO  TRAINING  GAP  CAN  BE  CLOSED  TO  SOME 
DEGREE  BY  REINSTITUTING  THE  11F  MOS  COMMENCING  AT  SKILL  LEVEL  FOUR 
IF  MILPERCEN  CAN  IDENTIFY  E-6'S  FOR  CONVERSION  TO  MOS  11F  WHEN  THEY 
SCREEN  RECORDS  FOR  ANCOC  SELECTION,  THEN  TRAINING  CAN  BEGIN  WITH  AN 
OPERATIONS/INTELLIGENCE  TRACK  ADDED  TO  THE  ADVANCE  COURSE.  WE  STILL 
WANT  TO  MAINTAIN  THE  PLATOON  SERGEANT  ORIENTATION  OF  ANCOC;  AFTER 
THE  STUDY  OF  CMF  11  COMMON  SKILLS,  THE  11B,  11C  AND  11H  SOLDIERS 
WILL  SEPARATE  FOR  SPECIALIZED  TRAINING  TO  MAKE  THEM  PLATOON  WEAPONS 
SYSTEM/EQUIPMENT  EXPERTS  WHILE  THE  11F  TRACK  BEGINS  THE  STUDY  OF 
THAT  SPECIALTY.  A  15%  INCREASE  IN  OUR  ANCOC  CAPACITY  WILL  ACCOMODATE 
THE  11F  MOS  ADDITION  AND  MAINTAIN  THE  RATIOH  OF  CMF  11  PLATOON 
SERGEANTS  TO  OPERATIONS/INTELLIGENCE  SERGEANTS  NEEDED  BY  UNITS  IN 
THE  FIELD. 
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A  PROVISION  FOR  11F  SKILL  LEVEL  FIVE  TRAINING  MUST  ALSO  BE  HADE 
IN  EITHER  THE  FORM  OF  AN  EXPORTABLE  COURSE,  TAUGHT  BY  A  FIELD  IN¬ 
STITUTION  OR  A  JOB  TRAINING  PACKAGE,  OR  AN  ON-THE-JOB  TRAINING 
PROGRAM  THAT  REFLECTS  ISO  DEVELOPMENT  OF  THE  HOS. 

"WITH  THE  DEVELOPMENT  OF  THE  INFANTRY  FIGHTING  VEHICLE,  WE  RECOGNIZE 
THE  REQUIREMENT  TO  ESTABLISH  THE  11/1  KOS  THROUGH  SKILL  LEVEL  TWO 
'  BECAUSE  WE  NEED  DRIVERS  AND  GUNNERS  FOR  THAT  SYSTEM.  WE  ARE  EXAMIN¬ 
ING  THE  POSSIBILITY  OF  TRACKING  THE  11 A  HOS  THROUGH  SKILL  LEVEL 
FOUR  USING  THE  ARMY'S  EXPERIENCE  GAINED  BY  THE  ARMOR  COMMUNITY 
AND  THE  RESULTS  OF  THE  TANK  FORCES  MANAGEMENT  GROUP  STUDY  UNDER 
LTG  KALE R3 IS,  I  BELIEVE  THAT  WE  MUST  ALSO  DEVELOP  A  MASTER  GUNNER'S 
PROGRAM,  HOWEVER,  THESE  MATTERS  WILL  BECOME  CLEARER  WITH  THE 
COMPLETION  OF  OPERATIONAL  TESTING  OF  THE  IFV. 

(SLIDE  n  16  -  RESTRUCTURED  C. IF ) 

BASICALLY,  USA  IS  DOES  NOT  THINK  THAT  THE  MIX  BETWEEN  IET,  NODES, 

(SLIDE  17  -  SUMMARY) 

AND  TRAINING  SUPPORT  IS  TOG  MUCH  OFF  THE  MARK.  CHANGES  COULD  BE 
MADE  TO  IMPROVE  IT,  MUCH  OF  WHAT  SHOULD  BE  DONE  IS  WITHIN  OUR 
PRESENT  CAPABILITY  AND  IS  CURRENTLY  BEING  ACCOMPLISHED.  WHAT  WILL 
MAKE  THE  MAJOR  DIFFERENCE  TO  UNITS  IS  TO  INCREASE  THE  CAPACITY 
OF  NOCES  TO  MAKE;  IT  AVAILABLE  TO  MORE  NCO'S. 
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IF  WE  MUST  STILL  OPERATE  AT  OUR  PRESENT  CAPACITY,  MILPERCEN  MUST  GET 
MORE  INVOLVED  IN  THE  PICTURE  TO  ASSURE  THAT  THE  NCO  SELECTED  TO 
RECEIVE  THE  TRAINING  IS  TRAINED  ENROUTE  TO  THE  POSITION  THAT 
REQUIRES  THAT  TRAINING.  IF  WE  DON'T  TRAIN  OUR  NCO  CORPS  BETTER,  WE 

WON'T  HAVE  AN  ARMY., 
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CAPABILITIES 


EVALUATION  AND  ANALYSIS 

1.  The  ISD  Process  and  how  it  should  work.  Commandant's  Stragegy 
drives  priorities. 

2.  Why  the  ISD  process  does  not  work  like  it  should  in  TRADOC. 

3.  DCD  input  to  ISD. 

4.  Feedback/evaluation  input  to  ISD. 

5.  Inprocess  Review  of  Phases  I,  II  and  III. 

6.  New  course  development  process: 

a.  Typical 

b.  A  different  way. 

7.  Evolutionary  change. 

8.  DEV  field  survey  data  for  analyses. 

9.  Internal  evaluation  data  for  analyses. 

10.  DEV  -  motor  to  cause  change. 

11.  Evaluation  program. 

12.  Principles  of  revising  training. 


I  am  the  strongest  supporter  of  the  ISD  Process  -  for  2  reasons: 

1.  I  have  been  in  the  Army  School  system  off  and  on  for  23  years  and 
lived  through  no  system  for  development  through  Systems  Engineering  to  ISD. 

2.  I  am  the  DEV  and  you  can't  be  in  evaluation  if  you  don't  understand 
and  support  the  process. 

Today,  I  propose  to  give  you  an  evaluators  over  view  of  the  process  and  some 

\t 

of  the  mistakes  we  make  and  my  thoughts  on  how  m  should  work.  • 

* 

1.  Process: 

A  way  to  accumulate  information  i.e.,  various  steps  by  which  we  accumulate 

different  kinds  of  information  about  a  given  job.  Each  of  products  of  process 

is  nothing  more  or  less  than  presentation  of  that  information.  You  can't 

make  presentation  until  processor  has  accumulated  information  to  be  presented. 

Why  doesn't  it  work?  Becausefnot  following  process  -  requiring  products 

out  of  sequence  -  stove  pipe  guidance  from  numerous  TRADOC  staff  elements 

exercising  their  priorities  in  isolation  of  others  and  the  process. 

SliJ)£  2.  You  have  to  start  with  Combat  Developments,  knowing  where  they  are, 

what  they  are  thinking  and  where  they  are  going. 

This  has  to  be  integrated  into  the  DTD  efforts  and  someone  has  to  oversee 

whats  going  on  so  the  program  can  be  fully  developed  and  resourced.  Thats 
(  ffitscu  rcfi  o&u} 

the  PRO'along  with  a  forum  of  representation  for  DTD/DCD/DOT/DEV  and  don't 
forget  DOS. 

3.  Where  does  DEV  fit  in.  DEV  should  be  the  focal  point  for  field  and 
DA  feedback  into  the  system. 

This  busy  chart  represents  the  thinking  of  my  design  and  control  folks 
in  developing  an  overall  evaluation  model  to  input  the  feedback  into  the 
process. 


tSL,  1 
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Its  not  all  inclusive  but  we  try  to  really  look  at  everything  that 
impacts  on  our  commandants  stragegy  and  where  it  fits  in  the  process. 

S  ^  'DC  4.  Here  is  a  simplified  view  of  what  I  have  just  described.  As  you 
see,  we  must  consider  DCD  input,  resource  requirements  impact,  feedback  - 

*  0 

DTD  efforts  integrated  and  all  evements  involved  in  programming. 

Don't  forget  to  measure  out* current  product  -  by  comprehensive  end-of- 

* 

course  testing  and  field  surveys  -  to  make  sure  we  are  not  making  changes 
where  they  are  not  necessary. 

5.  We  in  DEV  believe  that  the  we  can't  do  our  job  well  unless  we  are 
aware  of  whats  going  on  throughout  DTD,  so  we  are  attempting  to  implement 
an  in-process  review  system  through  a  series  of  checklists.  These  will  also 
give  us  an  audit  trail  to  tell  us  who,  what,  when,  where,  and  why  we  did 
things  in  the  process. 

The  A  -  E  arrofis  are  management  IPRs  to  tell  us  where  we  are  and  where 
we  should  go  from  here . 

6*  The  typical  process  as  viewed  by  some  people  looks  like  this.  Do 
all  tasks  completely  through  the  process.  This  throws  out  the  good  things 
we  already  have  (throwing  out  the  baby  with  the  bath  water) . 

S'ilf)^  7»  A  more  logical  approach  is  -  through  MGT  IPRs  and  careful  analysis 
of  current  courses  ojr  products  -  to  develop  only  those  which  are  new  or 
require  change. 

^  L  I  f)  C  8.  Here  we  see  portrayed  change  through  evolution  not  revolution.  Change 
gradually  what  needs  to  be  changed,  so  when  the  new  course  comes  on  line  or 
a  new  soldiers  manual  is  developed,  we  have  a  Revolutionary  change. 
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Good  morning,  ladies  and  gentlemen.  I'm  Jim  Rockey,  Director  of 
Evaluation  at  the  Transportat ion  School.  Wow!  This  has  been  some 
session.  What  we  have  been  talking  about  is  so  heavy  I  feel  like 
sending  out  for  a  Camp  David  sandwich  -  lamb  and  grits  on  a  bagel. 


This  briefing  should  be  a  little  lighter  -  The  Role  of  Evaluation 
in  Quality  Control  of  Training  Products.  Nothing  heavy  there!  All  the 
heavy  stuff  canes  later;  this  role  is  just  the  foundation.  And,  as  you 
well  know,  if  the  foundation  is  bad,  the  structure  is  bad.  Those  guys 
in  Pisa  who  built  their  tower  taught  us  that. 

If  we  don't  spend  resources  to  control  the  quality  of  Job  Analysis 
-  task  analysis  -  learning  design  -  and  materials  development,  all  the 
external  evaluations  in  the  world  won't  do  anymore  than  tell  us  we 
didn't  do  our  homework  before  we  issued  the  product  -  whether  that 
product  be  a  trained  mechanic  or  a  Commander's  Manual. 

Most  of  the  individual  performance  problems  we  discover  in  the 
field  could  be  prevented  with  adequate  quality  control  of  DTD  processes, 
months  -  even  years  -  before  the  product  was  issued. 


IN-PROCESS 

EVALUATION 

THE  KEY  TO 


QUALITY  TRAINING  PRODUCTS 


PROCESS  CONTROL  ^S  THE  KEY  TO  QUALITY  PRODUCTS. 

Let's  catch  a  little  history  and  underpin  our  discussion  with  some 
more  background. 


EXPLAIN  NEED  FOR  IN-PROCESS  REVIEW  OF 
DTD  BY  EXTERNAL  AGENT,  AND  GAIN 
MISSION  &  RESOURCES  FROM  BOSS. 


Oh,  by  the  way,  your  first  performance  objective  from  this  briefing 
is  this:  To  be  able  to  explain  the  need  for  external  in-process  review 
of  Training  Developments  to  such  a  degree  your  boss  will  assign  you  both 
the  mission  and  assets. 

When  School  Model  '76  was  designed,  the  essential  functions  of 
training  and  training  developments  were  separated,  in  part  to  provide  a 
higher  level  of  expertise  in  trailing  technology,  but  also  to  provide  a 
more  objective  control  of  course  content.  It  was  envisioned  that  by 
adding  objectivity  and  constant  review,  the  School  would  be  a 
self-correcting  mechanism,  never  again  to  suffer  the  pangs  of  curricular 
revolution.  This  self-correcting  feature  of  the  new  organization  was 
housed  in  an  independent  Directorate  of  Evaluation  -  the  few  smart  guys 
who  never  blink.  We  are  the  "self"  in  "self-correcting  mechanism." 


SELF-CORRECTING  MECHANISM 
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As  displayed  here,  the  Director  of  Evaluation,  (A) 

raises  his  arm  to  deliver  external  evaluation  report  (A-l)  or 
internal  evaluation  report  (A-2),  lifting  the  lid  on  the 
Assistant  Commandant's  box,  (B) 
who  springs  into  action,  (C) 

in  doing  so,  raises  his  hardened  and  sharpened  guidance 
rod,  (D) 

to  jab  the  actuator  mechanism  of  the  Director  of  Training 
Developments,  (E) 

who  pumps  furiously  causing  his  accordian  to  play  the  ISO  waltz 
fortissimo,  (F) 

which  causes  his  team  to  dance  quickly  about  in  circles  spewing 
out  new  Soldiers  Manuals  and  course  materials,  (G) 
and  being  linked  tightly  to  DOT,  (H) 

causing  him  to  march  in  a  different  direction,  kicking  new 
trainees  (I) 

into  a  unit's  performance  measurement  scales,  (J) 
which  closes  the  gate  switch,  (K) 

causing  Evaluation  to  be  struck  in  the  rear  by  a  bolt  of 
feedback  (L). 

The  major  reason  for  a  Directorate  of  Evaluation  being  placed  in  the 
School  Model  was  to  exercise  quality  control  of  school  operations  and  to 
energize  the  self-correcting  nature  of  the  school  organization  model. 


But  one  might  ask,  "Isn't  that  management's  job?" 

Yep!  It  sure  is.  And  that's  the  reason  Evaluation  reports 
directly  to  the  boss.  We're  the  "self;"  he's  the  "correcting."  We  give 
him  the  information  he  needs  to  make  corrections.  We  were  designed  to 
be  a  direct  extension  of  the  boss'  arm  to  scoop  up  facts  and  to  perform 
the  nitty-gritty  details  so  necessary  for  quality  In  this  business. 


Actually,  the  concept  is  borrowed.  The  financial  community  for 
years  has  used  a  concept  of  a  third-party  auditor.  When  one  buys  and 
sells  property,  the  money  goes  through  an  escrow  and  others  arrive  at 
who  pays  what  split.  Other  Government  agencies  such  as  Labor  and  HEW 
and  NASA  utilize  outside  evaluators  and  auditors  to  judge  the 
correctness  of  work.  And  the  concept  of  a  third-party  auditor  has  long 
been  standard  in  the  commercial  training  world,  especially  the 
curriculum  development  portion  of  that  world. 

And  in  our  military  world  it  makes  much  sense.  Even  the  best  of  us 
subjected  to  deadlines  or  pressing  suspenses  will  take  an  occasional 
liberty  with  a  prescribed  process.  We  sometimes  sneak  out  a  letter 
unchopped.  We  sometimes  back  into  numbers.  And  most  of  the  time  it 
makes  little  difference.  In  job  analysis,  haywiring  a  circuit  can  be 
deadly.  That's  like  using  cream  of  wheat  rather  than  cement  in  your 
concrete  mix.  DTD's  processes  are  so  important  to  the  end  items  of  our 
business  those  processes  must  be  verified  externally. 

The  result  of  failure  to  verify  processes  not  only  is  bad  task 
lists  -  bad  Soldier's  Manuals  -  bad  SQT's  -  bad  Commander's  Manuals, 
it's  bad  performance  in  units.  It's  lack  of  readiness,  and  that  causes 
revolutions  in  school  courses  -  wholesale,  slambam  changes  in  the  way  we 
train.  Our  job  as  the  motor  of  the  self-correcting  mechanism  is  to 
cause  evolutionary  change.  If  ever  we  need  to  revolutionize  a  course 
again,  you  and  I  have  failed  in  our  mission. 


LIFE  CYCLE  ASSESSMENT 


coMcarre 


Our  charter  is  life  cycle  assessment  of  all  proponent  systems  - 
particularly  the  training  subsystem.  It  is  we  who  must  set  the 
self-correcting  mechanisms  in  motion.  And  we  must  do  that  early-on. 
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If  we  are  to  perforin  this  vital  function,  we  cannot  hold  the 
evaluation  and  control  function  passive  until  Phase  V  of  the  Process. 
If  this  were  the  case  and  we  discovered  major  flaws  in  Job 


Analysis,  Step  1  of  Phase  I,  then  the  process  would  loop  back  and  start 
all  over  again  and  the  majority  of  2  or  3  years  of  invested  resources 
would  be  lost.  The  time  and  effort  lost  when  such  a  situation  exists 
can  hardly  be  considered  an  efficient  or  a  self-correcting  mechanism. 

The  risk  of  allowing  the  Training  Developments  process  to  run  for  2  or  3 
years  unchecked  except  by  internal  management  subject  to  incomplete 
training,  organizational  turbulence,  contracted  deadlines,  and  career 
pressures  should  be  unacceptable  to  any  prudent  general  mananger.  Thus, 
in-process  review  of  Training  Developments  is  a  key  ingredient  of 
successful  school  management. 


1.  WERE  ACTIONS  OBJECTIVE  &  SCIENTIFIC? 


2.  WAS  SAMPLE  ADEQUATE? 


3.  WERE  DATA  TREATED  PROPERLY? 


W  4 

lQ  1 

In  performing  these  TD  in-process  reviews,  one  needs  ask  only  three 
critical  questions: 

1.  Were  the  actions  taken  to  gain  this  information  objective  and 
scientific? 

2.  Was  the  sample  used  adequate  in  terms  of  both  quantity  and 
qual ity? 


3.  Were  the  data  which  were  produced  treated  properly? 

If  the  answer  to  any  is  "No,"  send  'em  back  to  square  one. 

Let's  look  at  each  question  briefly.  Incidentally,  in  the 
scientific  process,  we  cast  hypotheses  and  test  them.  In  our  Army 
practice  of  that  classical  process,  we  erect  strawmen  and  gain  reaction 
to  them.  One  can  observe  this  practice  throughout  this  briefing. 


WERE  ACTIONS  DURING  THIS  PHASE  OF 
THE  PROCESS  OBJECTIVE  AND  SCIENTIFIC? 


Were  actions  during  this  phase  of  the  process  objective  and 
scientific?  We  suggest  a  series  of  simple  checklists  to  formulate 
answers  to  that  question.  A  checklist  used  to  quantify  this  question  in 
Phase  I  must  determine,  for  example,  how  job  competencies  were  selected 
for  the  raw  task  list,  how  that  list  was  tested,  and  how  many  tasks  were 
rejected,  added,  or  modified  and  on  what  basis  these  modifications  were 
done.  Developers  tend  to  develop  a  personal  attachment  to  their  work 
and  products,  and  they  tend  to  become  emotionally  resentful  if 
validation  efforts  indicate  rejection  or  modification.  They  develop  a 
pride  of  authorship.  They  must  often  be  reminded  that  initial  efforts 
must  be  treated  as  a  strawman,  a  hypothesis,  not  a  conclusion. 
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WAS  THE  SAMPLE  ADEQUATE  IN  TERMS 
B  OF  BOTH  QUALITY  AND  QUANTITY? 

I 


Was  the  sample  adequate  in  terms  of  quality  and  quantity?  It  is 
important  first  to  ascertain  whether  we  have  data  from  a  scientifically- 
selected  sample,  or  a  catchment.  The  fact  that  25  percent  of  MOS 
holders  responded  to  an  information  survey  is  meaningless  unless  we  know 
which  25  percent  -  all  the  females?  All  the  short  termers?  All  the 
want-outs?  All  the  first  tenners?  A  scientific  sample  is  a  deliberate 
selection  by  some  orderly  means.  Perhaps  the  largest  and  most 
sophisticated  Job  Analysis  agency  in  the  world,  VTECS  a  subsidery  of  the 
Southern  Association  of  Schools  and  Colleges,  uses  Educational  Testing 
Service  to  control  respondents  in  Job  Analysis  surveys.  If  a  VTECS  Job 
Analyst  cannot  interview  the  craftsman  selected  by  a  computer  to 
respond,  he  must  return  to  the  computer  for  a  substitute  name.  After 
the  quality  of  the  sample  is  determined,  it  is  important  to  know  if  the 
number  of  respondents  in  the  sample  was  adequate.  Each  of  us  has  an 
employee  or  two  on  his  staff  who  knows  how  to  use  random  numbers  and 
other  statistical  control  tables.  By  the  way,  those  kinds  of  tables 
need  to  be  part  of  DTD  procedural  guides. 
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Were  the  data  treated  properly?  While  this  may  be  a  little  scary 
to  ask  if  you  don't  have  an  ORSA-type  in  your  hip  pocket,  it's  really 
very  simple.  Four  subquestions  need  to  be  answered. 


1.  PRESCRIBED  DESIGN  FOLLOWED? 

2.  ALL  RESPONSES  INCLUDED? 

3.  RESULTS  ARITHMETICALLY  CORRECT? 

4.  PROPER  CONCLUSIONS  DRAWN? 

1.  Was  the  prescribed  data  treatment  design  followed? 

2.  Were  all  data  -  all  responses  -  entered  into  the  analysis 

3.  Were  the  results  arithmetically  correct? 

4.  Were  proper  conclusions  drawn  from  the  data?  Note  that 
this  question  is  based  on  a  prescribed  data  treatment  paradigm. 


Now  back  to  the  key  question.  Shouldn't  DTD  management  be  asking 
those  questions  routinely?  Yep!  They  sure  should!  And  if  they  aren  t 
your  boss  needs  a  new  DTD.  Our  role  as  Evaluators  is  not  to 


EVALUATORS  AUDIT ! 


supervisors  MONITOR! 


monitor  DTD  or  other  peers,  it  is  to  audit  performance.  Directorate 
management  SUPERVISES ,  MONITORS ,  performance.  You  VERIFY  their  results. 
All  you  do  is  check  the  blocks  and  stamp  the  sheet.  And  if  the  machine 
is  working,  it  shouldn't  take  more  than  10  minutes. 

This  verification  process  proceeds  from  checkpoint  to  checkpoint, 
assuring  the  boss  that  no  one  has  haywired  a  million  dollar  course  by 
blinking  at  the  wrong  time.  Or  by  winking  at  any  time!  We'll  talk 
about  those  checkpoints  and  spell  them  out  in  some  detail  a  little 


Actually,  a  TD  In-Process  Review  System  isn't  unlike  driving  in  a 
sports  car  rally.  First,  if  your  DTD  has  a  thin  skin,  it  can  be  a  very 
sporty  course.  Second,  you  identify  those  points  you  consider  to  be 
critical  to  keep  on-route  and  make  those  points  checkpoints. 


EXPLAIN  NEED  FOR  IN-PROCESS  REVIEW  OF 
DTD  BY  EXTERNAL  AGENT,  AND  GAIN 
MISSION  &  RESOURCES  FROM  BOSS. 


Now  you  have  enough  information  to  perform  the  first  objective. 

In-process  verification  of  training  development  functions  is  an 
essential  evaluation  mission  which  can  be  conducted  without  great 
expenditure  of  resources,  if  properly  planned  and  completely  supported 
by  general  management.  The  first  objective  is  to  obtain  the  required 
support  from  the  Commandant  by  convincing  him  of  the  need  for  a  Training 
Development  In-Process  Review  System  and  by  obtaining  support  for 
necessary  authorizations  and  assets  to  conduct  this  program. 


PLAN  A  TD  IN-PROCESS 
REVIEW  SYSTEM 


The  second  objective  is  for  you  to  be  able  to  plan  a  TD  In-Process 
Review  System.  To  do  that  we  need  to  call  on  Mr.  Kipling's  five  honest 
serving  men:  Who,  When,  What,  Where,  and  Why. 
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We  have  already  discussed  "Why?"  Let's  add  "How?"  and  we're  in 
business. 


"Who?"  Let's  make  a  Job  Analysis.  The  requirement  is  to:  Read 
tables,  make  marks  on  a  checksheet,  add  or  multiply  numbers,  subtract  or 
divide  numbers,  ask  questions,  record  data,  draw  conclusions  and  make 
recommendations  to  you.  No  big  deal,  especially  if  DTD  is  set  up  with  a 
working  documentation  system,  and  you  have  checklists  to  match.  The 
entire  process  can  be  routinized  so  that  any  reasonably  able  E-5  can  do 
99  percent  of  the  audits.  In  some  cases  his  audit  will  lead  you  to 
throw  in  a  heavier  weight  -  a  numbers  cruncher  (that's  a  statistician, 
but  I  can't  pronounce  it),  a  subject  matter  super-expert,  etc.  And 
rarely,  you,  in  person,  will  have  to  rattle  cages  and  make  ugly  faces. 

So  if  those  circumstances  are  true,  how  many  "Who's"  do  you  need?  How 
long  is  a  road?  We  presently  forecast  that  everything  but  the  final 
check  can  be  done,  if  you  and  the  DTD  are  organized  and  all  documents  in 
sync,  in  about  16  hours  per  MOS.  Now,  spreading  that  16  hours  over  the 
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2  years,  or  whatever  time  your  DTD  has  been  taking  to  process  from  job 
analysis  to  materials  validation,  and  dividing  the  16  hours  by  that  time 
will  give  you  the  number  of  man-hours  per  year.  You  go  from  there.  The 
secret  is  get  it  organized  -  routinized  -  and  avoid  debate. 


"When?"  The  illustration  I  will  show  you  identifies  17  separate 
items  in  the  ISD  process  that  ought  to  be  checkpoints.  Additionally,  5 
of  these  17  ought  to  be  school  management  team  IPR's  and  decision 
points.  Actually,  each  school  must  design  its  own  system.  The  number 
of  checkpoints  a  school  uses  is  directly  proportional  to  the  amount  of 

risk  your  boss  is  willing  to  accept.  I'm  an  aviator.  I  don't  like 

risk.  The  system  I  will  illustrate  here  allows  us  to  get  down  from  any 

point  with  an  absolute  minimum  of  loss.  Let's  take  a  look. 


I  II  III 

ANALYZE  DESIGN  DEVELOP 


You  will  note  that  the  blocks  across  the  top  are  the  usual  ISD 
steps  taken  from  350-30.  We  do  not  exactly  ftillow  that  model  at  TSCH, 
and  it  is  unlikely  that  you  do  at  your  school.  Thus,  this  checkpoint 
sequence  used  here  is  illustrative  of  a  concept,  not  representative  of 
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what  we  are  trying  to  get  set  up.  Reading  down  the  chart,  note  at  the 
top  the  phases  in  Roman  numbers;  then  the  steps  of  ISD;  then  the  loops 
of  evaluation  verification  points;  then  arrows  showing  management  IPR's; 
and  finally  course  evolution  output  descriptors.  Let's  digress  for  a 
moment  and  explain  that  last  concept. 


TYPICAL  NEW  COURSE 


ii 
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In  doinq  a  new  course  of  instruction,  we  typically  move  all  tasks 
of  that  course  through  the  ISD  steps  simultaneously.  Thus  we  arrive  at 
Step  14,  "Validate"  with  an  entire  course,  or  an  entire  skill 
performance  aid  set,  or  some  other  entirety  to  be  tried  out  and 
calibrated.  And  as  long  as  we  are  working  on  something  entirely  new, 
and  we  have  enough  time  before  the  drop  dead  date,  we  can  follow  that 
process.  And  that  is,  I  believe,  precisely  what  most  DTD's  have  done. 
And  that  may  be  why  in  the  great  majority  of  our  schools,  DTD  has  had  no 
or  very  little  impact  on  resident  instruction  in  3  years.  Most  DTD's 
have  never  reached  Step  14  with  that  whole  mass  of  material,  and  USATSCH 
is  no  exception. 


However,  let's  consider  that  any  of  our  schools  will  rarely,  if 
ever,  have  either  the  luxury  of  all  the  time  we  want  or  the  need  to 
revise  everything  that  is  being  taught.  First,  with  our  new  systems  we 
do  not  have  2  or  3  or  4  years  from  the  time  we  can  nail  down  a  master 
task  list  to  get  instruction  on-line.  So  typically  we  start  new  systems 
instruction  in  one  mode,  a  lock-step  replica  of  IKPT,  and  switch  later  - 
maybe.  Second,  we  are  already  teaching  our  existing  systems.  We  have 
courses  on  line  for  all  of  our  existing  systems.  They  might  not  be 
"ISD'd; "  they  might  not  be  "self  paced;"  they  might  not  be  media 
intense;  but  they  do  teach,  and  in  most  cases  not  badly  either.  They 
have  tasks;  they  have  some  media;  they  have  a  lot  of  good  things.  They 
are  not  al 1  bad.  Yet  it  is  precisely  that  assumption  which  underlies  a 
process  which  develops  entirely  new  training  material  for  all  tasks  of 
an  existing  course  simultaneously.  Everything  must  be  replaced. 
Additionally,  th^t  process  is  revolutionary  course  by  course.  It  is  not 
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evolutionary;  and  evolution  is  what  the  School  Model,  and  we,  are  all 
about.  When  I  throw  out  a  major  course  and  bring  on  an  entirely  new 
course,  I  disrupt  the  status  of  training  and  competence  of  several 
hundred  instructors,  several  thousand  students,  throw  away  existing 
materials,  and  generally  spend  a  lot  of  money  to  get  back  to  where  I 
was.  That's  a  fairly  substantial  revolution.  Now  consider  alternatives 
to  revolution.  Let's  bring  on  a  new  course  one  task  at  a  time  and  let's 
make  one  change  at  one  time.  Let's  run  one  rabbit  into  one  hole  at  one 
time. 


DEVELOP  MATERIALS  ACCORDING  TO  NEED 
bed  AND  PAYBACK 


This  illustration  shows  us  running  one  task  through  the  entire 
sequence  and  bringing  it  on  line.  We  have  previously  prioritized  our 
tasks.  Entirely  new  tasks  to  satisfy  systems  modifications  or  training 
voids  are  first  priority.  Tasks  which  represent  serious  performance 
weaknesses  are  number  two.  The  others  come  down  as  the  amount  of  bang 
comes  down. 


Now  what  does  that  do?  Combined  with  the  evolutionary  output  from 
management  IPR's,  it  makes  for  course  evolution  not  revolution. 

WLWimim'Miuivim 


As  management  approves  a  new  task  list,  the  changes  that  task  list 
represents  should  begin  to  reflect  in  the  training  system.  If  tasks 
have  been  dropped,  they  should  be!  If  new  tasks  have  been  added,  they 
should  be  developed  and  added!  Thus  every  management  IPR  should  result 
in  evolutionary  changes  to  our  instruction  system.  Incidentally,  you 
will  hear  people  say  you  can't  insert  self-paced  tasks  or  blocks  into  a 
lock-step  course.  That's  nonsense.  The  entire  aviation  component  at 
Skyline  is  organized  on  that  concept,  as  are  many  entire  schools.  Every 
experienced  training  manager  in  our  system  knows  how  to  do  that. 

Now  let's  go  back  to  the  TD  In-Process  Review  System. 


I  II  III 

ANALYZE  DESIGN  DEVELOP 


Under  Step  1,  "Job  Analysis,"  are  two  checkpoints.  First  we  need  to 
verify  that  the  raw  task  list  -  the  original  strawman  that  goes  out  for 
reaction  -  is  drawn  from  all  required  sources,  not  just  from  CODAP  or 
not  just  from  some  SME ' s  experience,  or  not  just  from  what  some 
instructor  feels  he  would  like  to  teach  captains.  Our  experience  thus 
far  shows  that  if  that  first  strawman  is  not  carefully  constructed  -  not 
the  result  of  careful  and  thorough  research  -  the  possibility  for 
damagi ng-error  multiplies  immensely.  This,  by  the  way,  for  Evaluation 
is  a  checklist  job.  Second  we  need  to  verify  that  field  and  interview 
responses  to  the  strawman  have  been  properly  treated  and  the  raw  task 
list  revised  appropriately.  For  Evaluation  that  is  reading  a  table. 


Under  Step  2,  "Select  Tasks  &  Functions,"  also  are  two  checkpoints. 
First,  Evaluation  needs  to  verify  that  the  data  treatment  used  to 
formulate  the  master  task  list  -  a  process  chiefly  of  eliminating  tasks 
which  fall  to  the  periphery  of  the  delta  curve  and  must  be  specially 
tested  for  criticality  and  other  matters  to  be  retained  in  the  training 
universe,  have  been  proper.  For  Evaluation  this  is  reading  a  table  of 
numbers  or  a  algorithmic  worksheet.  Second,  Evaluation  must  certify  to 
management  that  all  prescribed  procedures  and  general ly  accepted 
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standards  were  followed  in  developing  the  training  structure  of  the  MOS. 
This  is  chopping  on  the  record  block  of  a  DTD  document.  At  tTvTs  poi nt 
the  full  management  team  should  be  assembled  as  a  board  of  senior 
professionals  and  recommend  to  the  boss  acceptance  or  rejection  of  the 
MOS  structure.  Parenthetical ly ,  this  sometimes  is  a  decision  -  as  in 
the  case  of  many  of  our  68  series  MOS  -  to  "take  on"  DA  DCSPER  and 
eliminate  one  EPMS  level.  Once  a  management  decision  is  made,  that  task 
list  should  begin  to  revise  the  training  system  for  that  MOS. 

Step  3,  "Construct  Job  Performance  Measures,"  also  has  two 
checkpoints.  First,  Evaluation  should  verify  that  the  "Job  Performance 
Measures"  are  in  fact  measurable  standards  of  the  job.  Th i s  involves 
reading  a  matrix  and  reading  tabled  numbers.  Second,  Evaluation  should 
verify  that  these  Job  Performance  standards  have  been  accepted  by  the 
field  and  all  agencies  concerned.  This  again  is  reading  a  checklist  and 
interpreting  numbers  or  checking  a  chop  record. 

Step  5,  "Select  Instruction  Setting,"  has  an  evaluation  checkpoint 
in  conjunction  with  the  second  management  IPR.  Evaluation  needs  to 
verify  that  instructional  setting  decisions  were  made  objecti vely.  That 
particular  decision,  by  the  way,  is  perhaps  the  most  difficult  decision 
of  the  set.  We  think  it  is  so  difficult  that  in  our  Transportation 
School  training  development  sequence  we  have  moved  that  block  to  follow 
design  rather  than  to  precede  it.  For  Evaluation,  this  means  reading  a 
matrix  and  interpreting  numbers,  especially  when  a  field-train  site 
selection  has  resulted.  It  means  also  reading  the  ARTEP  crosswalk.  The 
second  management  IPR  accepts  or  rejects  the  training  site  selection. 
Again,  once  that  decision  is  made  and  accepted  by  all  proper 
authorities,  the  training  system  should  begin  to  change. 

In  practice.  Steps  6  and  7,  "Develop  Objectives"  and  "Develop 
Criterion  Referenced  Test  Items"  are  really  one,  so  Evaluation  has  one 
checkpoint  with  two  items.  First,  Evaluation  verifies  that  the  training 
objectives  are  directly  rel ated  to  the  master  task  list,  and  are 
complete  and  are  measurable,  this  is  readi ng  a  matrix  and  using  some 
judgment.  Second,  Evaluation  verifies  that  the  criterion  test  items 
actually  reflect  the  conditions  and  standards  of  the  objective  and  do  jjn 
fact  measure  those  standards.  TFT?  is  reading  a  matrix  and  interpreting 
numbers. 

Step  9,  "Determine  Sequence  and  Structure,"  has  one  checkpoint  and 
this  one  only  because  all  so-called  design  functions  have  been 
completed.  At  this  point.  Evaluation  should  certify  to  management  that 
the  learning  design  is  according  to  management's  guidelines.  For 
example,  basic  skills  instruction  is  imbedded  in  the  tasks  rather  than 
separately  taught,  no  theory  is  included;  or  other  localisms. 

Evaluation  ought  also  to  verify  that  all  tasks  are  covered  in  the 
individual  training  package.  These  checkpoints  involve  only  reading  a 


detailed  learning  map  and  reading  a  multicolumn  checklist.  The  third 
management  I  PR  accepts  or  rejects  the  objectives,  CRH's,  the  MOS 
learning  map,  and  the  Individual  Training  Package  plan. 

Step  11,  "Specify  Instructional  Management  Plan  &  Delivery 
Systems,"  has  one  checkpoint.  Evaluation  needs  to  certify  to  management 
that  all  agencies  have  chopped  the  specific  support  requirements  of  the 
management  plan  and  that  CTEA~rs  have  been  done  objectively  -  DAFE  has 
committed  to  the  facilities  requirements,  supply  has  committed  to 
equipment,  AG  has  committed  to  printing,  DPCA  has  committed  to  personnel 
requirements,  etc.  For  Evaluation  this  involves  reading  a  chop  record. 
For  DTD  it  means  a  hell  of  a  lot  of  detailed  planning  typically  not  now 
being  done.  For  many  installation  support  functions,  it  means  not  being 
able  to  plead  ignorance  when  the  fun  starts.  It  should  be  noted  that 
this  is  a  critical  set  of  decisions  for  the  boss  to  make.  Based  on  this 
and  the  last  decision,  he  has  allocated  assets,  ordered  supplies  and 
equipment,  began  adjustments  and  modification  of  facilities,  etc.  Since 
the  course  has  been  evolving  in  this  direction  for  some  time,  the  shock 
wave  should  be  slight.  However,  to  turn  back  after  this  point  costs  a 
whole  bunch  of  money  and  heartburn. 

Step  12,  "Selection  of  Existing  Materials,"  calls  for  one 
checkpoint.  Evaluation  merely  reviews  £  checksheet  to  see  that  “make  or 
buy"  decisions  have  been  made  objectively.  We  look  to  see  that  DTD  has, 
in  fact,  looked  at  other  Army  schools,  other  services,  and  commercial 
courses  for  existing  materials  that  will  suit  the  objectives  just  as 
well  and  more  cheaply  than  simply  writing  new  materials. 

During  Step  13,  "Development  of  Instruction,"  Evaluation  should 
first  review  the  results  of  one-on-one  material  tryouts.  This  is  only 
reading  names  and  numbers  in  a  logbook.  Second,  Evaluation  should 
review  the  results  of  smal 1  group  trials.  Remember,  in  both  of  these 
checks  Evaluation  is  going  to  check  sample  quality.  It  is  especially 
critical  here  to  ascertain  that  the  trial  learners  are  representative  of 
the  target  population. 

In  Step  14,  "Val idation,"  Evaluation  finally  earns  its  money. 

Three  checks  are  critical.  First,  Evaluation  must  certify  to  the 
"goodness"  of  the  learner  sample,  as  in  the  one-on-one  trials  and  small 
group  trials.  Second,  Evaluation  should  observe  the  entire  validation 
iteration  -  from  staff  training  to  student  testing  -  to  ascertain 
compliance  with  the  course  management  plan  and  materials'!  Th i rd , 
Evaluation  must  conduct  comprehensive  testing  and  compare  those  test 
results  to  prescribed  job  performance  standards ,  CRTI  s,  and  certify  to 
management  the  results  of  the  validation  iteration.  For  Evaluation  tTrfs 
involves  developing  the  comprehensive  testing  plan,  likely  borrowing  and 
training  manpower,  gathering  and  crunching  a  lot  of  numbers,  etc.  But 
when  the  process  is  over,  the  managaiient  team  can  sit  down  together  in 
the  final  IPR,  consider  results,  and  make  its  recommendations  to  the 
boss.  If  you've  done  your  work  right,  the  product  goes  on  line. 
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Through  this,  or  some  other,  stringent  quality  control  system,  your 
directorate's  external  evaluation  functions  can  take  on  a  new  meaning. 
External  evaluation  will  then  mean  looking  for  performance  problems  on  a 
fine-tune  scale. 


And  that  was  "When?"  but  It  was  also  a  lot  of  "What?"  and  a  lot  of 
"How?". 


"Where?"  We  believe  that  Evaluation  work  should  take  place  on  the 
customer's  premises,  four  evaluator,  or  evaluators,  should  work  up  and 
down  your  DTD  halls  on  a  tightly  controlled  dally  schedule  with  set 
amounts  of  time  allowed  for  quality  checks.  But  that's  a  "How?" 
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HOW? 


VERY,  VERY 
CAREFULLY! 


And  speaking  of  "How?"  How  does  one  check  each  point?  Very,  very 
carefully.  The  DTD  process  is  spending  an  awful  lot  of  money.  It's 
your  job  to  see  that  the  product  is  worth  that  cost. 

What  we  have  tried  to  do  in  this  briefing  is  to  provide  information 
concerning  a  facet  of  the  Evaluation  Directorate's  mission  which  you 
might  not  have  fully  realized  or  considered.  As  a  result  of  possessing 
this  information  you  should  be  able  to  explain  a  TD  In-Process  Review 
System  to  your  boss  and  possibly  to  get  assets  to  perform  that  mission. 
You  should  also  be  able  to  plan  your  own  TD  In-Process  Review  System. 
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A  third  objective,  "Implement  the  System,"  is  one  we  are  still 
grappling  with.  But  I  can  assure  you  that  our  grappling  will  pay  off 
for  the  school.  Whether  we  eventually  perform  this  full  system  or  riot, 
simply  surfacing  the  issue  of  quality  control  in  Training  Developments' 
products  has  caused  the  DTD  group  to  begin  thinking,  and  acting,  in 
terms  of  more  stringent  quality  control.  And  I  believe  at  issue  is 
quality  control,  not  who  exercises  that  control.  But,  we  believe  that 
control  should  be  external  as  well  as  internal  to  the  DTD. 

If  all  men  were  always  objective,  and  scientific,  and  never  reacted 
adversely  to  short  deadlines  or  tough  suspenses  by  short  cutting  a 
system,  or  if  men  never  winked  away  requirements,  we  wouldn't  need  to 
worry  about  quality  control.  But  if  that  were  true,  Moses  would  have 
descended  the  mountain  with  10  Guidelines  cut  on  those  tablets,  not  10 
Commandments. 
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TRADOC  EVALUATION 
(HQ  PERSPECTIVE) 


The  word  Evaluation  evokes  varied  reactions  from  those  who  find  themselves 
subject  to  outside  scrutiny  of  their  efforts.  Quite  often  this  hesitant 
response  has  occurred  with  some  justification. 

The  familiar  phrase,  "we  are  here  to  assist  you,  not  to  inspect  you,"  is 
met  with  some  lack  of  credence  based  on  empirical  evidence  and  talcs  of 
the  virtual  end  of  the  line  for  those  who  "failed"  this  or  that  "assistance 
visit." 

Therefore,  the  biggest  problem/obstacle  for  "evaluators"  whether  at  HQ  TRADOC, 
in  the  schools  or  in  the  field  is  usefulness  of  purpose  and  credibility. 

The  single  most  important  aspect  of  credibility  is  to  provide  useful  feed¬ 
back  to  people  who  need  the  information  whether  they  be  analysts,  directors, 
the  Commandant,  or  field  commanders.  Part  of  that  change  is  to  direct  the 
feedback  to  a  level  of  authority  which  can  institute  change. 

Our  perception  of  the  roles  and^missions  of  the  school  directorates  of 
evaluation  are  as  follows: 

Perform  life-cycle  assessment  of  proponent  materiel  and  training  systems. 

Collect  and  analyze  individual  and  unit  performance  data. 

Conduct  internal  and  external  evaluations  as  specified  in  the  ISD  model. 

Develop,  conduct,  and  analyze  in-course  and  post-graduate  surveys. 

Analyze  effectiveness  of  resident  and  non-resident  instruction. 

Develop  studies  and  systems  to  measure  curricula  effectiveness. 

Identify  and  define  training,  training  development,  and  combat  development 
problems . 

Recommend  changes  to  training,  training  support,  and  materiel  systems. 

We  suggest  that  there  are  a  number  of  sources  and  techniques  that  evaluators 
can  use  to  facilitate  their  job.  These  include  but  are  not  limited  to: 

Army  Occupational  Survey  Program  reports. 

Army  Research  Institute  reports. 

DA  I G ,  TRADOC  IG,  FOKSCOM  IG  reports. 

TRADOC  liaison  reports. 

Missile  and  Munition  Evaluation  (MAME)  reports. 


Skill  Qualification  Test  (SQT)  results 


FORSCOM  training  assistance  and  assessment  team  visits 


FORSCOM  logistics  assessment  and  assistance  team  visits 


Consolidated  TRADOC  and  partnership  visits  to  FORSCOM  installations 
(begins  1  Oct  79). 


DARCOM  system  assessment  program  results 


The  next  point  might  ba  a  fine  issue  for  semantic  argument  but  my  reason 
for  bringing  it  up  at  this  time  is  to  present  our  view  of  the  separation 
of  the  two  prime  responsibilities  of  Validation  and  Evaluation. 


ILLUSTRATION 


What  is  the  answer  to  these  questions? 


Does  the  product  or  program  do  what  we  expect  it  to  do?  Does  the  lawn 
mower  really  cut  grass?  Does  tf»e  can  opener  cut  the  top  off  the  can  or 
Just  run  along  the  rim?  Can  the  student  about  to  graduate  perform  the 
critical  tasks  to  desired  standards?  I  suggest  that  the  answer  may  be 
found  in  Validation. 


Likewise,  what  is  the  answer  to  these  questions? 


What  is  the  reason  that  products  fail  to  meet  market/field  expectations 
and  what  can  be  done  about  it,  if  auy thing? 


Why  is  the  lawn  mower  difficult  to  start  for  a  110  lb  woman?  Why  does 
the  can  opener  cut  the  lids  off  some  cans  and  not  off  others?  Why  do 
supervisors  indicate  that  our  graduates  cannot  perform  certain  tasks  to 
the  standards  anticipated  in  the  field?  I  suggest  we  can  look  for  the 
answers  in  Evaluation. 


Therefore,  our  definitions  of  Validation  and  Evaluation  are 


VALIDATION:  Determination  of  whether  systems  or  products  meet  their  design 
goals  or  objectives  by  the  directorates  with  prime  responsibility  for  the 
system  or  product. 


EVALUATION:  Selected,  Independent  assessments  of  systems,  process  or  product 
effectiveness  conducted  primarily  by  the  Directorate  of  Evaluation  with 
feedback  to  other  directors,  the  Commandant,  and  the  field. 


It  may  be  of  interest  at  this  juncture  to  discuss  the  HQ  TRADOC  Evaluation 
Program  and  its  impact  on  the  schools.  The  program  was  initiated  at  the 
direction  of  GEN  Starry  in  December  1977  with  a  test  evaluation  visit  of 
the  Signal  Center,  Fort  Gordon,  occurring  at  the  end  of  February,  early 
March  1978. 


Mm 


The  mission  of  tho  Evaluation  Program  is  to  assess  the  effectiveness  of 
cent er/school  training  development  and  training  programs  and  to  provide 
assistance  where  and  when  feasible.  A  composite  team  of  representatives 
from  the  HQ  TRADOC  staff,  TDI,  ATSC,  and  the  Combined  Arms  Center  comprise 
tho  visiting  evaluation  team.  A  typical  mission  statement  would  be  as 
follows: 

MISSION 

TRADOC  Evaluation  Team  will  conduct  an  on-site  evaluation  of  the  US  Army 
Administration  Center  and  the  Defense  Information  School,  Fort  Benjamin 
Harrison,  IN,  during  the  period  30  May-8  June  1979,  to  obtain  quality 
assurance  data  on  training  products  developed  and  training  processes, 
us  part  of  the  Evaluation  of  the  TRADOC  Service  School  System. 

It  is  important  to  note  that  verbal  critiques  are  conducted  before  the 
team  leaves  the  Installation  and  a  written  report  is  given  to  the  Com¬ 
mandant  and  his  directors. 

In  essence,  the  purposes  of  the. evaluation  are: 

Provide  Training  Development  assistance  where  appropriate. 

Recommend  TRADOC/ATSC  policy  changes  where  appropriate. 

Evaluate  (review)  training  products/processes  for  the  School  Commandant 
as  requested. 

Provide  quality  assurance  to  DCST,  TRADOC  for  the  TRADOC  Commander. 

In  addition  to  the  verbal  critique  for  the  Commandant,  Assistant 
Commandant,  and  directors;  there  is  an  executive  session  with  the  team 
chief,  the  DCST,  and  the  Commandant  in  attendance.  On  occasion,  GEN 
Starry  has  participated  in  these  sessions. 

The  key  to  the.  success  of  these  evaluations  goes  back  to  the  issue  of 
credibility.  If  the  Commandant  and  the  directors  believe  that  change  is 
necessary  and  supports  the  overall  school/ccnter  strategy,  then  change 
will  occur. 

As  .1  matter  of  additional  information,  the  areas  that  are  evaluated  are: 

Threat 

ARTEP 

Total  Systems  Development  (CD/l'D  Interface) 

Job/Task  Analysis 
Soldier's  Manuals  (SM) 

Commander's  Manuals  (CM) 

Skill  Qualification  Test  (SQT) 

Extension  Training  Program 
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Course  Design  and  Development 
Conduct  of  Training 
Training  Management 
Combined  Arms  Training 
Staff  and  Faculty  Development 
School  Evaluation  System 


The  approach  is  one  of  an  in-depth  evaluation  of  the  training  development 
and  training  systems  for  two  MOS,  for  which  the  school/center  has  proponency 


Finally,  I  would  share  with  you  our  views  of  evaluation  shortcomings 
throughout  the  TRADOC.  Some  of  these  are: 


Lack  of  feedback  of  field  requirements  into  Training  Developments  (TO) 


(and  particularly  collective  requirements) 


Inadequate  data  on  the  use — or  lack  of  use — of  a  particular  school's 
training  support  materials  (TEC,  Devices,  Simulators,  etc.). 


Inadequate  use  of  available  materials  (SQT  task  analysis)  to  influence 
TD  process. 


Failure  to  Insure  that  Job  and  Task  Analysis  are  documented  and  sound 


In  summary,  all  of  these  issues  require  the  best  efforts  of  the  total 
assets  available  to  the  center/school.  The  best  working  relationship  in 
our  judgment  is  one  where  the  Directorate  of  Evaluation  is  viewed  by  the 
other  directorates  as  a  highly  credible  source  of  information  and  feedback. 
It  is  also  most  important  that  this  perception  is  shared  by  action  elements 
of  the  directorates  and  that  analysts,  and  design  and  developers  have  con¬ 
fidence  in  evaluators  as  a  constructive  part  of  the  process  and  not  a 
hindrance. 


Thank  you 


DONALD  W.  BARTLETT 

Office  of  the  Deputy  Chief  of  Staff 

for  Training 

Evaluation  Directorate 


